-- Logs begin at Wed 2022-08-31 04:38:57 UTC, end at Wed 2022-08-31 05:50:09 UTC. -- Aug 31 05:10:17.436114 dv-cinder-852208-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 05:10:17.445085 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 05:10:17 2022] *** Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: nodename: dv-cinder-852208-14-iscsi Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: machine: x86_64 Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: clock source: unix Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: pcre jit disabled Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: detected number of CPU cores: 4 Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: current working directory: / Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: detected binary path: /usr/bin/uwsgi-core Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: your processes number limit is 47680 Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: your memory page size is 4096 bytes Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: detected max file descriptor number: 2048 Aug 31 05:10:17.447005 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: lock engine: pthread robust mutexes Aug 31 05:10:17.447797 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: thunder lock: enabled Aug 31 05:10:17.447797 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 05:10:17.447797 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 05:10:17.485165 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: Python main interpreter initialized at 0x5625974409c0 Aug 31 05:10:17.485165 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: python threads support enabled Aug 31 05:10:17.485165 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: your server socket listen backlog is limited to 100 connections Aug 31 05:10:17.485165 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: your mercy for graceful operations on workers is 90 seconds Aug 31 05:10:17.485534 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 05:10:17.485534 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: *** Operational MODE: preforking *** Aug 31 05:10:17.486156 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: *** uWSGI is running in multiple interpreter mode *** Aug 31 05:10:17.486156 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: spawned uWSGI master process (pid: 105585) Aug 31 05:10:17.486337 dv-cinder-852208-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 05:10:17.487351 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: spawned uWSGI worker 1 (pid: 105586, cores: 1) Aug 31 05:10:17.487351 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: spawned uWSGI worker 2 (pid: 105587, cores: 1) Aug 31 05:10:17.487351 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 05:10:18.137832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 05:10:18.138489 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 05:10:19.193859 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:10:19.193859 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: from cryptography.utils import int_from_bytes Aug 31 05:10:19.194553 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:10:19.194553 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: from cryptography.utils import int_from_bytes Aug 31 05:10:19.194553 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:10:19.194553 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: from cryptography.utils import int_from_bytes Aug 31 05:10:19.195051 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:10:19.195051 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: from cryptography.utils import int_from_bytes Aug 31 05:10:21.647156 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 05:10:21.647733 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 05:10:21.647929 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 05:10:21.648288 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 05:10:21.648542 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 05:10:21.648928 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.649246 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.649569 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.649885 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.650207 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.650515 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-14-iscsi {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.653884 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 05:10:21.654275 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.654358 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 05:10:21.654437 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.654536 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 05:10:21.654617 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.654695 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 05:10:21.654774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.654850 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 05:10:21.654935 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.655023 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.655103 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.655197 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.655276 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.655364 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.656591 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.656753 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.656884 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657009 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657009 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657269 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657383 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657502 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657622 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657743 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657743 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657996 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.657996 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.658219 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.658287 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.658422 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.658557 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-14-iscsi {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.658650 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.658719 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.658842 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-14-iscsi {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659026 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659128 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659210 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659341 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659424 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659546 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659637 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659760 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659845 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.659964 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.660046 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.660287 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.660552 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.660707 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.660796 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.660876 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.661132 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.661286 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.661415 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.661514 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.661736 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.661914 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.662068 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.662175 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.662355 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.662503 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.662668 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.662816 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.662943 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.663062 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.663280 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.663459 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.663605 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.663744 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.663868 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.663988 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-14-iscsi {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.664134 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.664283 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.664409 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.664539 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.664670 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.664799 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.665009 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.665189 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.665324 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.665521 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.665742 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.665882 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.666059 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.666190 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.666327 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.666452 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.666574 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.666706 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.666831 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.666998 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.667130 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.667322 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.667501 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.667648 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.667787 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.667913 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.668043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.668173 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.668295 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.668464 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.668603 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.668799 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.668980 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.669137 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.669262 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.669398 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.669522 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.669653 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.669782 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.669908 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.670106 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.670238 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.670376 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.670581 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.670710 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.670830 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.670967 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.671089 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.671211 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.671331 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.671452 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.671571 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.671817 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.671999 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.672132 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.672257 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.672380 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.672514 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.672722 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.672900 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.673036 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.673162 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.673295 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.673430 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.673580 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.673709 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.673911 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.674134 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.674271 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.674414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.674540 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.674671 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.674877 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.675056 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.675056 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.675327 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.675458 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.675587 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.675709 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.675836 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.675966 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.676088 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.676210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.676449 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.676633 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.676766 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.676907 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.677044 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.677169 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.677298 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.677421 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.677610 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.677807 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.677952 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.678143 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.678280 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.678402 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.678533 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.678657 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.678842 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.678969 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.679098 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.679219 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.679386 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.679526 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.679658 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.679778 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.679998 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.680177 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.680327 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.680456 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.680604 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.680811 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.680940 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.681060 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.681197 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.681327 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.681451 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.681585 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.681712 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.681840 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.681969 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.682129 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.682277 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.682417 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.682577 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.682709 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.682917 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.683096 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.683239 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.683371 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.683497 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.683618 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.683756 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.683898 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.684029 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.684151 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.684315 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.684529 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.684663 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.684783 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.684911 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.685031 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.685163 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.685293 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.685503 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.685695 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.685849 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.685990 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.686184 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.686325 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.686456 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.686580 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.686702 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.686821 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.686957 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.687093 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.687225 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.687355 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.687482 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.687617 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.687809 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.688002 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.688137 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.688261 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.688381 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.688510 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.688705 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.688912 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.689047 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.689175 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.689297 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.689427 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.689567 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.689688 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.689848 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.689981 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.690214 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.690405 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.690551 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.690679 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.690820 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.691027 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.691155 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.691290 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.691423 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.691561 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.691684 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.691811 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.691934 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.692064 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.692224 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.692372 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.692526 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.692695 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.692819 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.693005 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.693130 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.693313 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.693446 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.693622 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.693745 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.693937 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.694092 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.694278 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.694402 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.694577 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.694699 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.694878 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.695005 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.695190 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:10:21.695323 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.695505 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.695641 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.695810 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.695933 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.696120 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.696251 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.696443 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.696582 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.696758 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.696889 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.697064 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.697209 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.697383 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.697507 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.697691 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.697826 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.697999 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.698145 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.698340 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.698480 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.698644 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.698768 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.698950 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.699074 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.699254 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.699393 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.699557 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.699679 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.699868 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.699998 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.700188 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.700322 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.700497 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.700622 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.700805 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.700935 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.701147 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.701281 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.701405 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.701525 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.701700 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.701825 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.702028 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.702155 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.702330 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.702455 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.702632 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.702761 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.702935 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.703059 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.703263 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.703388 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.703571 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.703695 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.703887 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.704011 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.704194 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.704317 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.704498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.704622 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.704803 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.704928 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.705107 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.705243 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.705418 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.705622 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.705747 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.705873 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.706061 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.706191 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.706366 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.706509 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.706666 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.706792 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.706970 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.707096 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.707268 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.707412 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.707571 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.707697 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.707878 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.708003 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.708173 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.708306 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.708476 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.708599 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.708782 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.708905 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.709088 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.709213 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.709392 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.709524 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.709697 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.709821 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.709992 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.710133 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.710320 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.710444 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.710623 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.710749 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.710919 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.711042 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.711254 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.711386 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.711507 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.711627 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.711796 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.711923 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.712096 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.712228 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.712396 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.712528 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.712692 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.712832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.712994 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.713117 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.713300 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.713437 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.713597 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.713728 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.713901 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.714070 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.714232 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.714371 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.714534 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.714657 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.714840 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.714975 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.715141 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.715274 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.715436 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.715561 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.715742 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.715867 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.716048 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.716187 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.716349 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.716474 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.716669 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.716793 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.716978 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.717105 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.717275 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.717398 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.717582 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.717713 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.717880 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.718071 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.718196 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.718329 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.718487 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.718605 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.718792 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.718916 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.719092 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.719217 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.719392 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.719525 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.719689 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.719821 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.719986 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.720115 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.720284 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.720417 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.720586 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.720717 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.720894 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.721030 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.721192 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.721340 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.721592 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.721721 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.721842 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.721962 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.722167 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.722310 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.722471 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.722596 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.722786 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.722911 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.723094 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.723220 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.723396 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.723521 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.723698 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.723822 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.723999 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.724124 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.724304 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.724429 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.724603 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.724739 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.724904 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.725030 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.725203 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.725328 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.725510 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.725634 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.725802 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.725928 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.726128 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.726253 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.726430 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.726554 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.726733 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.726859 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.727034 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.727158 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.727337 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.727475 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.727647 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.727770 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.727946 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.728069 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.728256 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.728389 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.728587 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.728704 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.728899 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.729023 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.729206 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.729339 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.729510 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.729633 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.729815 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.729937 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.730143 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.730281 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.730446 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.730569 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.730746 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.730869 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.731048 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.731165 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.731353 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.731466 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.731763 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.731951 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.732072 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.732183 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.732287 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.732390 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.732559 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.732681 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.732850 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.732962 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.733154 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.733265 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.733451 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.733561 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.734113 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.734256 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.734382 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.734503 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.734623 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.734744 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.734876 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.734998 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.735118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.735238 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.735366 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.735807 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.735934 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.736055 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.736175 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.736296 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.736466 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.736600 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.736777 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.736902 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.737101 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.737238 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.737403 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.737539 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.737711 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.737835 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.738054 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.738176 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.738346 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.738652 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.738952 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.739261 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.739564 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.739864 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.740095 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.740365 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.740487 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.740594 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.740834 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.740959 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.741075 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.741181 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.741352 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.741464 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.741668 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.741844 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.741982 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.742117 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.742289 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.742414 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.742609 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.742733 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.742941 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.743086 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.743209 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.743330 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.743485 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.743621 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.743783 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.743907 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.744122 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.744247 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.744430 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.744564 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.744731 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.744855 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.745041 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.745163 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.745356 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.745495 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.745659 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.745781 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.745966 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.746122 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.746296 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.746612 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.746922 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.747232 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.748026 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.748026 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.748266 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.748380 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.748494 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.748599 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.748741 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.748922 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.749042 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.749258 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.749369 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.749584 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.749695 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.749909 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.750072 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.750257 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.750384 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.750566 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.750676 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.750848 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.750976 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.751152 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.751263 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.751488 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.751610 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.751841 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.752014 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.752142 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.752303 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.752429 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.752573 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.752743 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.752997 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.753108 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.753321 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.753433 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.753643 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.753908 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.754043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.754280 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.754392 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.754592 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.754710 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.754899 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.755011 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.755207 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.755318 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.755515 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.755636 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.755823 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.755952 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.756130 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.756273 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.756450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.756582 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.756759 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.756901 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.757065 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.757197 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.757366 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.757490 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.757664 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.757788 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.757972 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.758165 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.758298 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.758428 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.758593 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.758871 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.758999 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.759190 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.759313 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.759492 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.759624 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.759792 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.759915 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.760092 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.760209 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.760431 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.760687 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.760825 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.760968 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.761093 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.761214 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.761335 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.761455 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.761585 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.761706 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.761860 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.761985 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.762200 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.762339 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.762505 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.762629 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.762806 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.762940 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.763103 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.763241 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.763405 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.763531 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.763706 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.763831 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.764012 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.764147 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.764312 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.764437 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.764614 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.764740 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.764912 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.765046 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.765214 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.765341 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.765525 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.765649 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.765811 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.765937 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.766166 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.766306 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.766468 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.766610 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.766785 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.766924 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.767090 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.767222 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.767391 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.767514 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.767687 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.767820 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.767990 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.768116 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.768320 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.768448 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.768629 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.768756 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.768931 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.769055 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.769237 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.769369 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.769538 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.769662 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.769849 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.769973 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.770185 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.770327 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.770487 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.770622 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.770823 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.770948 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.771078 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.771210 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.771372 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.771496 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.771671 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.771795 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.771973 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.772106 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.772271 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.772393 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.772590 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.772718 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.772870 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.772995 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.773173 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.773297 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.773473 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.773605 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.773770 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.773894 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.774097 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.774222 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.774395 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.774539 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.774708 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.774842 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.775011 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.775135 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.775308 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.775430 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.775607 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.775740 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.775911 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.776034 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.776210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.776344 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.776506 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.776630 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.776901 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.777073 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.777210 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.777342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.777473 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.777608 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.777738 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.777863 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.777988 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.778147 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.778281 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.778403 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.778590 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.778724 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.778888 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.779023 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.779183 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.779308 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.779477 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.779601 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.779777 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.779903 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.780074 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.780198 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.780370 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.780486 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.780670 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.780810 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.781000 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.781135 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.781267 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.781390 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.781520 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.781643 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.781838 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.781963 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.782189 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.782489 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.782794 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.783097 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.783398 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.783697 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.784053 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.784350 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.784648 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.784944 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.785246 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.785547 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.785866 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790064 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790202 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790279 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790348 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790416 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790503 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790608 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790703 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790774 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790774 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790893 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.790959 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791034 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791109 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791178 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791243 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791308 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791382 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791456 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791524 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791590 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791655 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791721 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791837 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791906 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.791974 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792039 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792105 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792170 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792243 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792311 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792378 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792378 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792525 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792593 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792675 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792746 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792812 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792877 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.792944 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.793009 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.793082 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.793148 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.793927 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794039 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794113 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794194 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794263 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794329 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794329 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794448 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794516 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794599 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794673 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794742 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794808 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.794873 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.795139 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.795238 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.795381 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.795519 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.795655 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.795798 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.795934 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.796089 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.796227 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.796361 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.796503 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.796639 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.796859 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.796998 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.797132 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.797265 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.797400 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.797533 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.797678 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.797826 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.797961 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.798126 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.798297 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.798439 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.798589 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.798735 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.798871 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.799015 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.799175 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.799315 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.799481 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.799647 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.799822 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.799971 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.800254 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.800416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.800553 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.800694 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.800856 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.800998 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.801156 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.801360 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.801500 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.801679 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.801818 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.801994 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.802169 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.802350 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.802491 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.802637 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.802772 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.803020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.803159 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.803339 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.803477 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.803644 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.803784 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.804128 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.804348 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.804501 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.804646 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.804790 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.804924 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.805059 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.805203 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.805340 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.805482 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.805618 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.805752 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.805886 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.806077 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.806221 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.806356 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.806490 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.806623 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.806756 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.806904 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.807039 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.807179 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.807316 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.807587 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.807737 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.807894 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.808056 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.808206 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.808342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.808590 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.808747 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.808885 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.809018 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.809189 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.809330 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.809509 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.809678 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.809828 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.809982 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.810174 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.810319 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.810455 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.810588 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.810732 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.810877 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.811011 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.811158 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.811322 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.811524 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.811673 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.811855 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.812007 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.812167 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.812307 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.812484 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.812640 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.812777 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.812911 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.813109 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.813248 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.813417 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.813580 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.813716 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.813851 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.814207 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.814361 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.814499 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.814712 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.814852 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.814986 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.815085 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.815210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.815418 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.815517 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.815724 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.815810 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.816024 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.816110 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.816332 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.816418 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.816632 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.816732 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.816932 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.817017 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.817233 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.817318 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.817541 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.817633 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.817844 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.817928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.818175 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.818477 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.818603 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.818780 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.818881 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.819078 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.819186 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.819378 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.819476 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.819693 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.819788 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.819989 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.820091 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.820308 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.820402 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.820613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.820707 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.820931 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.821025 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.821245 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.821338 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.821547 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.821641 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.821866 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.821963 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.822197 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.822428 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.822520 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.822739 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.822847 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.823072 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.823166 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.823408 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.823793 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.824004 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.824097 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.824321 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.824423 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.824648 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.824745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.824971 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.825061 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.825277 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.825364 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.825589 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.825687 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.825915 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.826022 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.826360 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.826679 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.826767 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.827002 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.827091 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.827311 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.827405 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.827611 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.827706 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.827916 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.828005 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.828216 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.828303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.828513 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.828599 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.828814 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.828903 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.829116 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.829215 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.829413 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.829507 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.829713 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.829800 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.830041 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.830168 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.830334 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.830468 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.830638 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.830727 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.831013 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.831101 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.831350 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.831446 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.831652 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.831781 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.831956 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.832096 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.832254 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.832403 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.832594 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.832705 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.832894 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.833009 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.833217 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.833414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.833523 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.833724 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.833842 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.834090 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.834260 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.834405 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.834577 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.834728 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.834892 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.835047 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.835203 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.835367 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.835516 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.835684 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.835828 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.836000 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.836140 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.836317 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.836447 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.836632 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.836760 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.836948 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.837072 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.837259 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.837393 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.837576 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.837891 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.837977 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.838893 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.839006 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.839091 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.839199 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.839390 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.839522 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.839839 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.840154 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.840469 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.840688 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.840794 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.841082 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.841395 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.841705 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.842023 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.842141 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.842362 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.842687 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.842879 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.843001 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.843325 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.843639 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.843831 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.843933 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.844252 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.844542 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.844647 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.845094 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.845576 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.845685 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.845891 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.846238 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.846469 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.846589 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.846913 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.847179 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.847285 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.847524 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.847840 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.848122 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.848235 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.848458 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.848771 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.849014 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.849116 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.849381 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.849706 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.849867 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.850071 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.850396 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.850666 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.850771 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.851009 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.851322 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.851506 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.851856 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.852172 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.852431 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.852544 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.852814 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.853137 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.853240 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.853450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.853765 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.853995 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.854114 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.854406 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.854708 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.854893 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.854995 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.855311 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.855596 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.855700 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.855922 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.856232 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.856424 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.856527 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.856838 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.857108 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.857223 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.857664 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.857802 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.858029 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.858351 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.858586 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.858689 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.858984 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.859283 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.859388 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.859590 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.859912 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.860128 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.860230 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.860823 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.861142 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.861380 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.861495 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.861740 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.862084 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.862349 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.862451 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.862693 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.862997 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.863198 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.863303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.863593 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.863917 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.864146 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.864249 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.864506 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.864806 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.865078 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.865175 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.865401 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.865700 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.866026 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.866248 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.866345 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.866611 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.866909 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.867193 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.867299 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.867502 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.867809 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.868113 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.868339 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.868443 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.868747 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.869066 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.869286 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.869390 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.869651 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.869965 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.870224 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.870320 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.870603 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.870910 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.871163 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.871267 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.871544 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.871859 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.872089 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.872394 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.872727 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.873047 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.873377 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.873603 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.873710 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.873995 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.874318 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.874412 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.874615 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.874711 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.874938 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.875056 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.875248 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.875385 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.875556 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.875722 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.875864 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.876055 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.876170 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.876394 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.876481 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.876711 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.876811 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.877055 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.877209 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.877363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.877542 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.877745 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.877916 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.878027 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.878259 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.878346 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.878590 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.878696 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.878908 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.878996 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.879216 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.879303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.879524 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.879620 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.879841 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.879935 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.880163 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.880478 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.880645 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.880790 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.880989 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.881087 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.881311 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.881402 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.881640 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.881732 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.881967 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.882106 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.882293 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.882384 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.882608 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.882705 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.882934 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.883027 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.883241 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.883341 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.883544 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.883636 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.883904 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.883995 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.884224 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.884328 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.884530 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.884621 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.884833 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.884924 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.885146 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.885246 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.885456 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.885548 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.885757 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.885850 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.886133 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.886371 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.886515 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.886652 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.886798 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.886938 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.887085 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.887224 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.887361 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.887509 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.887681 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.887833 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.888003 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.888147 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.888292 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.888429 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.888575 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.888721 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.888869 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.889014 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.889152 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.889295 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.889443 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.889580 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.889726 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.889864 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.890053 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.890201 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.890359 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.890513 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.890661 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.890800 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.890937 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.891074 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.891219 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.891376 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.891515 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.891652 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.891788 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.891962 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.892107 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.892255 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.892439 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.892588 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.892827 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.892973 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.893112 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.893290 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.893436 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.893574 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.893724 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.893864 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.894043 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.894189 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.894328 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.894464 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.894602 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.894739 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.894888 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.895025 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.895222 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.895368 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.895506 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.895643 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.895837 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.895981 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.896167 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.896311 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.896481 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.896632 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.896783 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.896922 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.897090 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.897250 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.897390 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.897536 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.897696 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.897840 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.898057 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.898206 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.898344 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.898495 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.898634 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.898772 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.898938 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.899100 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.899268 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.899425 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.899565 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.899703 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.899868 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.900011 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.900178 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.900330 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.900468 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.900607 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.900776 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.900927 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.901088 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.901228 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.901387 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.901530 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.901706 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.901850 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.901998 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.902173 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.902337 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.902490 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.902652 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.902822 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.903048 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.903192 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.903331 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.903468 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.903605 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.903757 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.903897 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.904044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.904183 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.904322 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.904460 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.904606 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.904746 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.904897 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.905035 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.905180 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.905318 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.905464 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.905603 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.905740 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.905910 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.906100 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.906259 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.906406 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.906545 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.906692 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.906830 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.906992 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.907145 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.907307 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.907458 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.907741 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.907885 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.908069 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.908223 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.908369 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.908507 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.908663 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.908810 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.909002 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.909148 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.909323 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.909467 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.909629 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.909780 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.909951 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.910120 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.910317 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.910477 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.910617 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.910765 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.910915 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 05:10:21.911056 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.911327 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.911629 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.911925 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.912230 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.912543 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.912846 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.913144 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.913439 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.913760 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.914084 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.914376 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.914667 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.914965 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.915268 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.915562 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.915857 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.916150 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.916443 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.916737 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.917030 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.917330 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.917784 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.918112 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.918412 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.918709 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.919005 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.919330 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.919688 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.919996 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.920314 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.920721 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.921041 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.921344 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.921657 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.921968 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.922302 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.922605 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.922931 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.923234 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.923536 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.923842 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.924146 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.924448 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.924803 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.925122 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.925440 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.925739 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.926078 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.926390 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.926703 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.927014 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.927318 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.927747 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.928063 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.928367 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.928674 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.928979 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.929283 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.929591 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.929895 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.930224 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.930536 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.930946 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.931269 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.931590 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.931894 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.932212 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.932531 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.932870 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.933177 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.933515 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.933835 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.934172 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.934479 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.934776 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:10:21.935013 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 05:10:22.063230 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO dbcounter [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Registered counter for database nova_api Aug 31 05:10:22.085396 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_db.sqlalchemy.engines [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:10:22.091479 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Registered counter for database nova_api Aug 31 05:10:22.092051 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writer thread running {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:10:22.111411 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:10:22.118380 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:10:22.149872 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.context [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c5b09df-1bba-4015-8eaa-e92ec93ae071(cell1) {{(pid=105586) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 05:10:22.153647 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:10:22.154142 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:10:22.155711 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:10:22.156432 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:10:22.156866 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:10:22.158881 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:10:22.160853 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO dbcounter [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Registered counter for database nova_cell0 Aug 31 05:10:22.164836 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO dbcounter [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Registered counter for database nova_cell1 Aug 31 05:10:22.172094 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_db.sqlalchemy.engines [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:10:22.173828 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_db.sqlalchemy.engines [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:10:22.177263 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.context [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c5b09df-1bba-4015-8eaa-e92ec93ae071(cell1) {{(pid=105587) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 05:10:22.178647 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writer thread running {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:10:22.181156 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:10:22.181625 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:10:22.183239 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:10:22.183983 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:10:22.184422 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:10:22.186895 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_concurrency.lockutils [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:10:22.189092 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Registered counter for database nova_cell0 Aug 31 05:10:22.193252 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Registered counter for database nova_cell1 Aug 31 05:10:22.200194 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:10:22.203626 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:10:22.207070 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:10:22.213189 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:10:22.315462 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writer thread running {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:10:22.325465 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO dbcounter [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Registered counter for database nova_cell0 Aug 31 05:10:22.334546 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_db.sqlalchemy.engines [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:10:22.339659 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writer thread running {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:10:22.356715 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO dbcounter [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Registered counter for database nova_cell0 Aug 31 05:10:22.364582 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG oslo_db.sqlalchemy.engines [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:10:22.369611 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writer thread running {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:10:22.672979 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: WARNING keystonemiddleware.auth_token [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 05:10:22.674271 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 05:10:22.680445 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: WARNING keystonemiddleware.auth_token [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 05:10:22.681528 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 05:10:23.020873 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 05:10:23.022711 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: WARNING keystonemiddleware.auth_token [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 05:10:23.026850 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: WARNING keystonemiddleware.auth_token [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 05:10:23.028675 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: WARNING keystonemiddleware.auth_token [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 05:10:23.032078 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625974409c0 pid: 105587 (default app) Aug 31 05:10:23.033975 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625974409c0 pid: 105586 (default app) Aug 31 05:10:23.034214 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:10:23.035407 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-a9e6875d-9374-4eca-8b35-8a04693b9639 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001801 Aug 31 05:10:23.035804 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed Aug 31 05:10:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:11:40.345768 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:40.347201 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 Aug 31 05:11:40.347645 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:11:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:11:40.359591 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:40.360735 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell0:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:40.361550 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell1:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:40.362541 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_cell0:SELECT=3 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:41.202525 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-f620037d-9271-4fcf-823d-c1d1ad17f87f admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:41.233564 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-f620037d-9271-4fcf-823d-c1d1ad17f87f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.879602 Aug 31 05:11:41.238057 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Aug 31 05:11:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:11:43.591124 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:43.592136 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-9c2b4f85-6539-461d-b224-4ecc71475ecd None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 31 05:11:43.592769 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:11:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:11:44.039187 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-c7e298f3-762c-4607-854d-57a8d4ae03ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:44.087192 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-c7e298f3-762c-4607-854d-57a8d4ae03ed admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488565 Aug 31 05:11:44.087955 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:11:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:11:44.101241 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_api:SELECT=3 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:44.102085 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_cell1:SELECT=3 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:44.103050 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_cell0:SELECT=3 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:44.104058 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:44.307136 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-375db591-ca8f-4466-8c2b-a0e3fee9e01c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:44.368607 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-375db591-ca8f-4466-8c2b-a0e3fee9e01c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.272436 Aug 31 05:11:44.369193 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 05:11:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:11:46.713260 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-c7e298f3-762c-4607-854d-57a8d4ae03ed admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:46.714266 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-c7e298f3-762c-4607-854d-57a8d4ae03ed admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 31 05:11:46.714904 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:11:47.362321 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-4048f83e-9c1c-4138-8e18-ab65a22ab219 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:47.401506 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-4048f83e-9c1c-4138-8e18-ab65a22ab219 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.680027 Aug 31 05:11:47.402601 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:11:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:11:47.414892 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-be68979a-2d8a-42e1-b8aa-7362f302eb85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:47.450098 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-be68979a-2d8a-42e1-b8aa-7362f302eb85 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038780 Aug 31 05:11:47.451388 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 05:11:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:11:49.787765 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-4048f83e-9c1c-4138-8e18-ab65a22ab219 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:49.788780 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-4048f83e-9c1c-4138-8e18-ab65a22ab219 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 31 05:11:49.789152 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:11:50.192345 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-47cea317-a7e2-4f0d-84b7-4aca6abe3b0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "name": "ds1G"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:50.212327 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-47cea317-a7e2-4f0d-84b7-4aca6abe3b0a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.417048 Aug 31 05:11:50.212857 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:11:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:11:50.225049 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-fa96bc23-8b51-4be9-917b-8d47bafd10da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:50.248663 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-fa96bc23-8b51-4be9-917b-8d47bafd10da admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027435 Aug 31 05:11:50.249387 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 05:11:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:11:52.600498 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-47cea317-a7e2-4f0d-84b7-4aca6abe3b0a admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:52.602108 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-47cea317-a7e2-4f0d-84b7-4aca6abe3b0a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Aug 31 05:11:52.608111 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:11:53.052860 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-ed7ba33a-8cc0-4450-b2b8-e89815d4494b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "swap": 0, "disk": 10, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:53.073771 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-ed7ba33a-8cc0-4450-b2b8-e89815d4494b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464303 Aug 31 05:11:53.074529 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:11:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 05:11:53.086539 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-b0c3e789-ad1b-47f6-a733-9ef1211e109b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:53.112692 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-b0c3e789-ad1b-47f6-a733-9ef1211e109b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029772 Aug 31 05:11:53.113275 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 05:11:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:11:55.422811 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-ed7ba33a-8cc0-4450-b2b8-e89815d4494b admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:55.423798 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-ed7ba33a-8cc0-4450-b2b8-e89815d4494b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 31 05:11:55.424387 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:11:55.836514 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-a456516d-96c3-4a46-8263-5347fa584037 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "name": "ds4G"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:55.858731 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-a456516d-96c3-4a46-8263-5347fa584037 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427376 Aug 31 05:11:55.860190 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:11:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 05:11:55.872944 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-ef658451-ed06-4588-994a-40ab0650d5e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:11:55.897804 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-ef658451-ed06-4588-994a-40ab0650d5e9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029469 Aug 31 05:11:55.899014 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 05:11:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:11:58.548532 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-a456516d-96c3-4a46-8263-5347fa584037 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:58.549794 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-a456516d-96c3-4a46-8263-5347fa584037 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001952 Aug 31 05:11:58.550680 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:11:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:11:58.977163 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-09c07bd3-8b6a-4b5d-945b-257d95cae5c2 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:11:59.003354 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-09c07bd3-8b6a-4b5d-945b-257d95cae5c2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446725 Aug 31 05:11:59.003926 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Aug 31 05:11:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:12:01.653284 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-a456516d-96c3-4a46-8263-5347fa584037 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:01.654337 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-a456516d-96c3-4a46-8263-5347fa584037 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 31 05:12:01.654745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:12:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:02.080560 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-ff75a03a-ca8b-43b7-8cc8-0175a30a8441 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:02.100339 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-ff75a03a-ca8b-43b7-8cc8-0175a30a8441 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.439443 Aug 31 05:12:02.100896 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:12:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:02.115311 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-e73d1d7a-f439-4607-b044-1df52b426d0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:02.141019 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-e73d1d7a-f439-4607-b044-1df52b426d0c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029434 Aug 31 05:12:02.141591 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 05:12:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:12:04.450664 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-ff75a03a-ca8b-43b7-8cc8-0175a30a8441 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:04.451557 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-ff75a03a-ca8b-43b7-8cc8-0175a30a8441 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 31 05:12:04.451959 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:12:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:04.816772 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-89be9c66-0120-493e-aa94-079976089d94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "id": "2"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:04.835791 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-89be9c66-0120-493e-aa94-079976089d94 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.377365 Aug 31 05:12:04.836425 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:12:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:04.848604 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-69bd585e-2876-4d61-89ef-5a6017b0a470 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:04.872580 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-69bd585e-2876-4d61-89ef-5a6017b0a470 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027647 Aug 31 05:12:04.873152 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 05:12:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:12:07.199041 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-89be9c66-0120-493e-aa94-079976089d94 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:07.200706 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-89be9c66-0120-493e-aa94-079976089d94 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002235 Aug 31 05:12:07.201148 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:12:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:07.648929 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-6192227c-bac0-41fd-815b-ff43982a127f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "ram": 4096, "id": "3"}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:07.674250 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-6192227c-bac0-41fd-815b-ff43982a127f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466120 Aug 31 05:12:07.675355 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:12:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:07.689571 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-8e5f801b-6a9b-4348-8f50-3134c5cdf177 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:07.715411 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-8e5f801b-6a9b-4348-8f50-3134c5cdf177 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031592 Aug 31 05:12:07.715993 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 05:12:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:12:10.159041 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-6192227c-bac0-41fd-815b-ff43982a127f admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:10.160172 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-6192227c-bac0-41fd-815b-ff43982a127f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 Aug 31 05:12:10.160564 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:12:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:10.667467 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-77571edd-7d7c-453e-8d8f-9eef36e36057 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "disk": 80}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:10.675236 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:10.689524 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-77571edd-7d7c-453e-8d8f-9eef36e36057 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.522526 Aug 31 05:12:10.690089 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:12:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:10.702407 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-8344804b-7b5a-4f5b-a718-531fba15d708 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:10.727774 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-8344804b-7b5a-4f5b-a718-531fba15d708 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029045 Aug 31 05:12:10.728476 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 05:12:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:12:13.084738 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-77571edd-7d7c-453e-8d8f-9eef36e36057 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:13.085753 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-77571edd-7d7c-453e-8d8f-9eef36e36057 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 31 05:12:13.086372 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:13.537301 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-67bb4d00-88be-44fb-b4d5-7a2e2510c624 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "id": "5"}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:13.556481 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-67bb4d00-88be-44fb-b4d5-7a2e2510c624 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464249 Aug 31 05:12:13.557270 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 05:12:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:13.569146 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-4234451f-64b1-4a50-9ad4-57cad1b06ae5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:13.597387 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-4234451f-64b1-4a50-9ad4-57cad1b06ae5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031857 Aug 31 05:12:13.597893 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 05:12:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:12:31.483377 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-67bb4d00-88be-44fb-b4d5-7a2e2510c624 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:31.484577 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-67bb4d00-88be-44fb-b4d5-7a2e2510c624 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Aug 31 05:12:31.485167 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:12:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:31.500168 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:31.910248 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-70331769-2f21-41a0-8ce2-fb5a8b7d95a0 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:31.930461 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-70331769-2f21-41a0-8ce2-fb5a8b7d95a0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.435231 Aug 31 05:12:31.930991 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Aug 31 05:12:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:12:32.994637 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-67bb4d00-88be-44fb-b4d5-7a2e2510c624 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:32.995695 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-67bb4d00-88be-44fb-b4d5-7a2e2510c624 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 05:12:32.996087 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:33.556673 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-6ce2e63d-32ce-462d-a05b-58b5a63f7711 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:33.562863 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-6ce2e63d-32ce-462d-a05b-58b5a63f7711 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-6ce2e63d-32ce-462d-a05b-58b5a63f7711 admin admin] Request method failure captured: Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Accept: application/json Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Connection: keep-alive Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Content-Length: 0 Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Host: 10.222.0.36 Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.90 Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjDu3A2Li_23P4zHHFUkqnC2sAVMFnp6nWBUKvSqSdst1NZzGFy0mOov3Q4R17YSYfuUSkT3RLharbg0NiJfXxEbJsL07rJqoLpZyjADWyMZrYoPJ5IGsM_TWS8AfKODkbRrmfP2enp9fDSa0LljtfIprMz52XJUdYjTN463nzDp2CYdg Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Role: reader,admin,member Aug 31 05:12:33.566118 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Roles: reader,admin,member Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e3bdb87df7f4087806a21456cb45a01", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant: admin Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User: admin Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Id: c96b7a6c0bc940caab4581734c1919ee Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Name: admin Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: method: > Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: exception: Flavor 42 could not be found. Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: action_args: {'id': '42'} Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:12:33.567745 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:33.568832 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.570342 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-6ce2e63d-32ce-462d-a05b-58b5a63f7711 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:12:33.571614 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-6ce2e63d-32ce-462d-a05b-58b5a63f7711 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.419356 Aug 31 05:12:33.571614 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Aug 31 05:12:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:33.577317 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-87d16613-e510-4047-8ad7-d8644bb6d59b admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:33.581547 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:33.602665 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-87d16613-e510-4047-8ad7-d8644bb6d59b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028920 Aug 31 05:12:33.603234 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 05:12:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:12:33.613312 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-e39765f4-83a9-49e5-804e-76ed2ab952c2 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:33.636942 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-e39765f4-83a9-49e5-804e-76ed2ab952c2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027161 Aug 31 05:12:33.637482 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 05:12:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:12:33.647068 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-c13fd31f-e9e7-4835-a6d1-9c23c8248e40 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:33.653570 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.wsgi [None req-c13fd31f-e9e7-4835-a6d1-9c23c8248e40 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-c13fd31f-e9e7-4835-a6d1-9c23c8248e40 admin admin] Request method failure captured: Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Accept: application/json Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Accept-Encoding: gzip, deflate Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Connection: keep-alive Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Content-Length: 0 Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Host: 10.222.0.36 Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Openstack-Api-Version: compute 2.90 Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Openstack-System-Scope: None Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: User-Agent: python-novaclient Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Auth-Token: gAAAAABjDu3A2Li_23P4zHHFUkqnC2sAVMFnp6nWBUKvSqSdst1NZzGFy0mOov3Q4R17YSYfuUSkT3RLharbg0NiJfXxEbJsL07rJqoLpZyjADWyMZrYoPJ5IGsM_TWS8AfKODkbRrmfP2enp9fDSa0LljtfIprMz52XJUdYjTN463nzDp2CYdg Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Domain-Id: None Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Domain-Name: None Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Identity-Status: Confirmed Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Is-Admin-Project: True Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Domain-Id: default Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Domain-Name: Default Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Name: admin Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Role: reader,admin,member Aug 31 05:12:33.656861 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Roles: reader,admin,member Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e3bdb87df7f4087806a21456cb45a01", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant: admin Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant-Name: admin Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User: admin Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Domain-Id: default Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Domain-Name: Default Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Id: c96b7a6c0bc940caab4581734c1919ee Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Name: admin Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: method: > Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: exception: Flavor 42 could not be found. Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: action_args: {'id': '42'} Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:12:33.658363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:33.659303 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:33.660348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-c13fd31f-e9e7-4835-a6d1-9c23c8248e40 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:12:33.661347 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-c13fd31f-e9e7-4835-a6d1-9c23c8248e40 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014792 Aug 31 05:12:33.661347 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Aug 31 05:12:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 05:12:34.626370 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-e39765f4-83a9-49e5-804e-76ed2ab952c2 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:34.627382 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-e39765f4-83a9-49e5-804e-76ed2ab952c2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 31 05:12:34.627779 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:12:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:35.191892 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-9a09e076-3902-4e02-b156-69ab69cdcbea admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:35.197476 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.wsgi [None req-9a09e076-3902-4e02-b156-69ab69cdcbea admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-9a09e076-3902-4e02-b156-69ab69cdcbea admin admin] Request method failure captured: Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Accept: application/json Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Accept-Encoding: gzip, deflate Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Connection: keep-alive Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Content-Length: 0 Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Host: 10.222.0.36 Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Openstack-Api-Version: compute 2.90 Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Openstack-System-Scope: None Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: User-Agent: python-novaclient Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Auth-Token: gAAAAABjDu3Cs7BRX0nyQb3d_Pil9tcx-TlS4Z6i9GMXjjKrs5Uks_8zm-yyU6NGmSANX3v_V_pYDqQatadK9DTlzYthjrntVoYqXoY4iDZbUDV9_HWrgNdwOK5EhfJyEfnNKENw6Ab-SMf8oGJWsgUcf8vibO5Lk1hr08XFauxo52WbqeVDVdg Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Domain-Id: None Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Domain-Name: None Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Identity-Status: Confirmed Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Is-Admin-Project: True Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Domain-Id: default Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Domain-Name: Default Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Name: admin Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Role: reader,admin,member Aug 31 05:12:35.199018 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Roles: reader,admin,member Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e3bdb87df7f4087806a21456cb45a01", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant: admin Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant-Name: admin Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User: admin Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Domain-Id: default Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Domain-Name: Default Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Id: c96b7a6c0bc940caab4581734c1919ee Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Name: admin Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: method: > Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: exception: Flavor 84 could not be found. Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: action_args: {'id': '84'} Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:12:35.200579 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:35.201450 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.202498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-9a09e076-3902-4e02-b156-69ab69cdcbea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:12:35.203581 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-9a09e076-3902-4e02-b156-69ab69cdcbea admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.436400 Aug 31 05:12:35.203581 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Aug 31 05:12:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:35.210292 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-b0bdffce-73d3-4df6-8988-7bf16c1cb85d admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:35.225539 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-b0bdffce-73d3-4df6-8988-7bf16c1cb85d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018836 Aug 31 05:12:35.226104 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 05:12:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:12:35.235961 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-50fbeb89-bf3a-4036-a85e-b61dee5bb47d admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:35.251175 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-50fbeb89-bf3a-4036-a85e-b61dee5bb47d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018706 Aug 31 05:12:35.251702 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 05:12:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:12:35.260949 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-65e2db82-80df-4465-a68b-5e75822a0e8c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:35.266513 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-65e2db82-80df-4465-a68b-5e75822a0e8c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-65e2db82-80df-4465-a68b-5e75822a0e8c admin admin] Request method failure captured: Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Accept: application/json Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Connection: keep-alive Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Content-Length: 0 Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Host: 10.222.0.36 Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.90 Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjDu3Cs7BRX0nyQb3d_Pil9tcx-TlS4Z6i9GMXjjKrs5Uks_8zm-yyU6NGmSANX3v_V_pYDqQatadK9DTlzYthjrntVoYqXoY4iDZbUDV9_HWrgNdwOK5EhfJyEfnNKENw6Ab-SMf8oGJWsgUcf8vibO5Lk1hr08XFauxo52WbqeVDVdg Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Role: reader,admin,member Aug 31 05:12:35.268020 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Roles: reader,admin,member Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e3bdb87df7f4087806a21456cb45a01", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant: admin Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User: admin Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Id: c96b7a6c0bc940caab4581734c1919ee Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Name: admin Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: method: > Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: exception: Flavor 84 could not be found. Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: action_args: {'id': '84'} Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:12:35.269416 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:35.270414 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:35.271516 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-65e2db82-80df-4465-a68b-5e75822a0e8c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:12:35.272567 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-65e2db82-80df-4465-a68b-5e75822a0e8c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011870 Aug 31 05:12:35.272567 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Aug 31 05:12:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:36.266275 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-50fbeb89-bf3a-4036-a85e-b61dee5bb47d admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:36.267315 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-50fbeb89-bf3a-4036-a85e-b61dee5bb47d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 31 05:12:36.267719 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:12:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:36.846268 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-e21094e7-f3a6-4218-86de-20e8e01d3f8a admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:36.852306 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.wsgi [None req-e21094e7-f3a6-4218-86de-20e8e01d3f8a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-e21094e7-f3a6-4218-86de-20e8e01d3f8a admin admin] Request method failure captured: Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Accept: application/json Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Accept-Encoding: gzip, deflate Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Connection: keep-alive Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Content-Length: 0 Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Host: 10.222.0.36 Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Openstack-Api-Version: compute 2.90 Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Openstack-System-Scope: None Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: User-Agent: python-novaclient Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Auth-Token: gAAAAABjDu3ES_I7wUjShVXGQEeLtM-_n5qiPcX_Z8KQjVyTm1Zw1laDYDQLpN7KEkuDJbqxEPfeoEgCwponBdn7lu0XeIJ1GF8YtigHBRFS_cSHpAPRq0Rgv8stRw1iD57XFfomfLHo56_JBcVh6UOjmV-6K_d8-AodwOSWxN54K8c4FQA-3yU Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Domain-Id: None Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Domain-Name: None Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Identity-Status: Confirmed Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Is-Admin-Project: True Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Domain-Id: default Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Domain-Name: Default Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Project-Name: admin Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Role: reader,admin,member Aug 31 05:12:36.853797 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Roles: reader,admin,member Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e3bdb87df7f4087806a21456cb45a01", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant: admin Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-Tenant-Name: admin Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User: admin Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Domain-Id: default Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Domain-Name: Default Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Id: c96b7a6c0bc940caab4581734c1919ee Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: X-User-Name: admin Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: method: > Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: exception: Flavor 451 could not be found. Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: action_args: {'id': '451'} Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:12:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:36.856044 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.857774 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-e21094e7-f3a6-4218-86de-20e8e01d3f8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:12:36.859025 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-e21094e7-f3a6-4218-86de-20e8e01d3f8a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.440510 Aug 31 05:12:36.859025 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 05:12:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:36.866065 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-61fb758a-085c-4459-a72e-20c8beffdd2a admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:36.880919 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-61fb758a-085c-4459-a72e-20c8beffdd2a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018348 Aug 31 05:12:36.881433 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 05:12:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:12:36.890780 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:36.906095 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018682 Aug 31 05:12:36.906639 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 05:12:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:12:36.915881 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-832431bf-9fa4-43fd-9270-481aace13e83 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:36.921516 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.wsgi [None req-832431bf-9fa4-43fd-9270-481aace13e83 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-832431bf-9fa4-43fd-9270-481aace13e83 admin admin] Request method failure captured: Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Accept: application/json Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Accept-Encoding: gzip, deflate Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Connection: keep-alive Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Content-Length: 0 Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Host: 10.222.0.36 Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Openstack-Api-Version: compute 2.90 Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Openstack-System-Scope: None Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: User-Agent: python-novaclient Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Auth-Token: gAAAAABjDu3ES_I7wUjShVXGQEeLtM-_n5qiPcX_Z8KQjVyTm1Zw1laDYDQLpN7KEkuDJbqxEPfeoEgCwponBdn7lu0XeIJ1GF8YtigHBRFS_cSHpAPRq0Rgv8stRw1iD57XFfomfLHo56_JBcVh6UOjmV-6K_d8-AodwOSWxN54K8c4FQA-3yU Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Domain-Id: None Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Domain-Name: None Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Identity-Status: Confirmed Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Is-Admin-Project: True Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Domain-Id: default Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Domain-Name: Default Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Project-Name: admin Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Role: reader,admin,member Aug 31 05:12:36.923043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Roles: reader,admin,member Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e3bdb87df7f4087806a21456cb45a01", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e3bdb87df7f4087806a21456cb45a01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant: admin Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant-Id: 3e3bdb87df7f4087806a21456cb45a01 Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-Tenant-Name: admin Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User: admin Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Domain-Id: default Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Domain-Name: Default Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Id: c96b7a6c0bc940caab4581734c1919ee Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: X-User-Name: admin Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: method: > Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: exception: Flavor 451 could not be found. Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: action_args: {'id': '451'} Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:12:36.924613 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:36.925928 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: ERROR nova.api.openstack.wsgi Aug 31 05:12:36.927276 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-832431bf-9fa4-43fd-9270-481aace13e83 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:12:36.928500 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-832431bf-9fa4-43fd-9270-481aace13e83 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012059 Aug 31 05:12:36.928500 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 05:12:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:37.889424 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:37.890474 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 31 05:12:37.890867 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:38.455762 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-c3e06beb-ca60-45ef-b1e5-97b0891dd8d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:38.487559 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-c3e06beb-ca60-45ef-b1e5-97b0891dd8d1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.461112 Aug 31 05:12:38.488124 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Aug 31 05:12:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:39.476883 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:39.478276 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Aug 31 05:12:39.478780 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:12:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:40.046432 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-3a252558-89cc-49c0-a9b3-684546c7d842 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:40.067616 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-3a252558-89cc-49c0-a9b3-684546c7d842 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.450551 Aug 31 05:12:40.068163 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Aug 31 05:12:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:41.084535 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:41.085534 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 31 05:12:41.085925 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:12:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:41.625682 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-c2e74e10-e8c9-410c-b2a9-12bef042fafa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:41.646354 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-c2e74e10-e8c9-410c-b2a9-12bef042fafa admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.423759 Aug 31 05:12:41.646901 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Aug 31 05:12:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:42.622540 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:42.623875 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Aug 31 05:12:42.624481 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:43.170363 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-8e57a8f9-d514-4ac2-895a-32c7809a0809 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:12:43.191377 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-8e57a8f9-d514-4ac2-895a-32c7809a0809 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.424030 Aug 31 05:12:43.191914 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Aug 31 05:12:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:12:44.178100 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:44.179112 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 31 05:12:44.179509 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:12:44.746565 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-df45b433-ec5d-45e4-8f6b-d06882c6d883 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:12:44.766925 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-df45b433-ec5d-45e4-8f6b-d06882c6d883 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.451394 Aug 31 05:12:44.767456 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed Aug 31 05:12:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:13:38.145432 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:13:38.147180 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-99f26b9f-3ebb-4315-b602-c60195d91255 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002374 Aug 31 05:13:38.147821 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 05:13:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:13:38.161100 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:38.563534 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-f380ce29-2880-45af-9d49-a1831e00baae admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:13:38.586676 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-f380ce29-2880-45af-9d49-a1831e00baae admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430008 Aug 31 05:13:38.587122 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Aug 31 05:13:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:13:38.612860 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG dbcounter [-] [105587] Writing DB stats nova_api:SELECT=14 {{(pid=105587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:38.616934 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2569ed53-e94d-451a-8c21-3332302b88e7 admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:13:38.625097 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2569ed53-e94d-451a-8c21-3332302b88e7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014129 Aug 31 05:13:38.625619 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1283 bytes} [Wed Aug 31 05:13:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:13:38.639440 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-c73135b7-bb10-4a14-a2cb-a88d7eb1a875 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:13:38.647612 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-c73135b7-bb10-4a14-a2cb-a88d7eb1a875 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013235 Aug 31 05:13:38.648137 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1286 bytes} [Wed Aug 31 05:13:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:13:38.659821 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:13:38.667558 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011370 Aug 31 05:13:38.668080 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1286 bytes} [Wed Aug 31 05:13:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:13:38.682039 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-609a1026-2706-4b2f-a592-482c211cc845 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:13:38.690348 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-609a1026-2706-4b2f-a592-482c211cc845 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011979 Aug 31 05:13:38.690863 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1283 bytes} [Wed Aug 31 05:13:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:16:39.156026 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:16:39.157036 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 31 05:16:39.157420 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:16:39.296480 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_api:SELECT=6 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:16:39.480643 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-03f92a28-420a-481b-a7fa-4172d75330bb admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:16:39.484240 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-03f92a28-420a-481b-a7fa-4172d75330bb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:16:39.484703 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-03f92a28-420a-481b-a7fa-4172d75330bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:16:39.485142 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-03f92a28-420a-481b-a7fa-4172d75330bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:16:39.485836 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-03f92a28-420a-481b-a7fa-4172d75330bb admin admin] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:16:39.486277 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-03f92a28-420a-481b-a7fa-4172d75330bb admin admin] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:16:39.486677 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-03f92a28-420a-481b-a7fa-4172d75330bb admin admin] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:16:39.521435 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-03f92a28-420a-481b-a7fa-4172d75330bb admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.227520 Aug 31 05:16:39.522035 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 05:16:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:16:40.349140 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:16:40.350217 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 31 05:16:40.350631 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:16:40.557952 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-732fe6e9-b238-4b09-9e84-945069ed4157 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:16:40.561410 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-732fe6e9-b238-4b09-9e84-945069ed4157 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:16:40.561876 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-732fe6e9-b238-4b09-9e84-945069ed4157 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:16:40.562316 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-732fe6e9-b238-4b09-9e84-945069ed4157 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:16:40.563022 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-732fe6e9-b238-4b09-9e84-945069ed4157 admin admin] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:16:40.563498 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-732fe6e9-b238-4b09-9e84-945069ed4157 admin admin] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:16:40.563847 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-732fe6e9-b238-4b09-9e84-945069ed4157 admin admin] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:16:40.584235 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-732fe6e9-b238-4b09-9e84-945069ed4157 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.092041 Aug 31 05:16:40.584792 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 05:16:40 2022] GET /compute/v2.1/os-services => generated 794 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:16:51.836582 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:16:51.837986 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Aug 31 05:16:51.838572 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:16:51.979204 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_cell0:SELECT=4 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:16:51.979794 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_cell1:SELECT=4 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:16:51.980544 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG dbcounter [-] [105586] Writing DB stats nova_api:SELECT=8 {{(pid=105586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:16:52.032471 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-3fa6fec5-4d5b-4ddc-b166-a88739866c11 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:16:52.035929 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-3fa6fec5-4d5b-4ddc-b166-a88739866c11 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:16:52.036389 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-3fa6fec5-4d5b-4ddc-b166-a88739866c11 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:16:52.036851 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-3fa6fec5-4d5b-4ddc-b166-a88739866c11 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:16:52.037491 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-3fa6fec5-4d5b-4ddc-b166-a88739866c11 admin admin] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:16:52.037988 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-3fa6fec5-4d5b-4ddc-b166-a88739866c11 admin admin] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:16:52.038416 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-3fa6fec5-4d5b-4ddc-b166-a88739866c11 admin admin] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:16:52.063377 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-3fa6fec5-4d5b-4ddc-b166-a88739866c11 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.088803 Aug 31 05:16:52.063921 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 05:16:51 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:16:52.894802 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: DEBUG nova.api.openstack.wsgi [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] Calling method '>' {{(pid=105587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:16:52.895780 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: INFO nova.api.openstack.requestlog [None req-2e15e925-da38-4305-b709-e7215d03ad9c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Aug 31 05:16:52.896182 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: [pid: 105587|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 05:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:16:53.090179 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG nova.api.openstack.wsgi [None req-fac18801-21c2-46bd-84dc-3eb806aeb098 admin admin] Calling method '>' {{(pid=105586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:16:53.093540 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-fac18801-21c2-46bd-84dc-3eb806aeb098 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:16:53.094052 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-fac18801-21c2-46bd-84dc-3eb806aeb098 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:16:53.094482 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-fac18801-21c2-46bd-84dc-3eb806aeb098 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:16:53.095194 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-fac18801-21c2-46bd-84dc-3eb806aeb098 admin admin] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:16:53.095630 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-fac18801-21c2-46bd-84dc-3eb806aeb098 admin admin] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:16:53.096043 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: DEBUG oslo_concurrency.lockutils [None req-fac18801-21c2-46bd-84dc-3eb806aeb098 admin admin] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:16:53.118936 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: INFO nova.api.openstack.requestlog [None req-fac18801-21c2-46bd-84dc-3eb806aeb098 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083792 Aug 31 05:16:53.119483 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: [pid: 105586|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 05:16:53 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:17:49.512938 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: Wed Aug 31 05:17:49 2022 - graceful shutdown triggered... Aug 31 05:17:49.512225 dv-cinder-852208-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 05:17:49.513926 dv-cinder-852208-14-iscsi devstack@n-api.service[105586]: Gracefully killing worker 1 (pid: 105586)... Aug 31 05:17:49.514333 dv-cinder-852208-14-iscsi devstack@n-api.service[105587]: Gracefully killing worker 2 (pid: 105587)... Aug 31 05:17:50.513402 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: worker 1 buried after 1 seconds Aug 31 05:17:50.513402 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: worker 2 buried after 1 seconds Aug 31 05:17:50.513402 dv-cinder-852208-14-iscsi devstack@n-api.service[105585]: goodbye to uWSGI. Aug 31 05:17:50.516061 dv-cinder-852208-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 05:17:50.517112 dv-cinder-852208-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 05:17:50.522202 dv-cinder-852208-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 05:17:50.538061 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 05:17:50 2022] *** Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: nodename: dv-cinder-852208-14-iscsi Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: machine: x86_64 Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: clock source: unix Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: pcre jit disabled Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: detected number of CPU cores: 4 Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: current working directory: / Aug 31 05:17:50.540236 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: detected binary path: /usr/bin/uwsgi-core Aug 31 05:17:50.540899 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: your processes number limit is 47680 Aug 31 05:17:50.540899 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: your memory page size is 4096 bytes Aug 31 05:17:50.540899 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: detected max file descriptor number: 2048 Aug 31 05:17:50.540899 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: lock engine: pthread robust mutexes Aug 31 05:17:50.540899 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: thunder lock: enabled Aug 31 05:17:50.540899 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 05:17:50.540899 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 05:17:50.582446 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: Python main interpreter initialized at 0x558d10c8e9c0 Aug 31 05:17:50.582446 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: python threads support enabled Aug 31 05:17:50.582446 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: your server socket listen backlog is limited to 100 connections Aug 31 05:17:50.582446 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: your mercy for graceful operations on workers is 90 seconds Aug 31 05:17:50.582895 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 05:17:50.582895 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: *** Operational MODE: preforking *** Aug 31 05:17:50.583182 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: *** uWSGI is running in multiple interpreter mode *** Aug 31 05:17:50.583182 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: spawned uWSGI master process (pid: 120594) Aug 31 05:17:50.583398 dv-cinder-852208-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 05:17:50.583984 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: spawned uWSGI worker 1 (pid: 120607, cores: 1) Aug 31 05:17:50.584345 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: spawned uWSGI worker 2 (pid: 120608, cores: 1) Aug 31 05:17:50.584484 dv-cinder-852208-14-iscsi devstack@n-api.service[120594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 05:17:51.245409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 05:17:51.257961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 05:17:52.389574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:17:52.389574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: from cryptography.utils import int_from_bytes Aug 31 05:17:52.390406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:17:52.390406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: from cryptography.utils import int_from_bytes Aug 31 05:17:52.400904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:17:52.400904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: from cryptography.utils import int_from_bytes Aug 31 05:17:52.401406 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:17:52.401406 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: from cryptography.utils import int_from_bytes Aug 31 05:17:54.788322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 05:17:54.788919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 05:17:54.789008 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 05:17:54.789331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 05:17:54.789618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 05:17:54.789978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.790332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.790680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.791003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.791587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.791900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.792231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.792543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.792855 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.793117 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.793436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.793757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-14-iscsi {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.794136 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.794441 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.794718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.795062 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.795333 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.795656 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.795987 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.796463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.798295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.798625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.798954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.799341 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.799673 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.799997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.800310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.800615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.800947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.801273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.801664 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-14-iscsi {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.801984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.802317 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.802632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.803060 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.803387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.803685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.804008 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.804335 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.804644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.804980 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.805301 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.805621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.805942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.806267 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.806578 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.806879 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.807205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.807512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.807816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.808068 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.808372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.808692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.809017 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.809332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.809581 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.809830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.810170 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.810491 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.810796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.811103 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.811404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.811713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.812008 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.812309 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.812610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.812758 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 05:17:54.813253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.813414 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 05:17:54.813584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.813584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.813896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 05:17:54.814087 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.814252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 05:17:54.814252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 05:17:54.814570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.814570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.815044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.815199 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.815359 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.815511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.815663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.815818 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.815987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.816136 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.816298 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.816451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.816594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.816744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.816897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.817039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.817212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.817385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.817558 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.817729 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.818458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.818630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.818788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.818932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.819075 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-14-iscsi {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.819224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.819401 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.819633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.819786 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.820048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.820048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.820359 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.820525 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.820679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.820838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.820993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.821233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.821382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.821526 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.821679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.821830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.821973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.822195 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.822361 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.822522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.822674 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.822819 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.822970 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.823113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.823262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.823424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.823424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.823704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.823855 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.824005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.824148 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.824310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.824455 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.824599 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.824755 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.824902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.825104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.825260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.825412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.825564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-14-iscsi {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.825718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.825871 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.826054 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.826215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.826381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.826531 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.826683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.826840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.826984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.827134 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.827294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.827445 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.827594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.827738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.827890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.828673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.828857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.829012 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.829164 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.829164 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.829446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.829616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.829770 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.829915 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.830092 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.830244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.830395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.830552 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.830704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.830870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.831023 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.831173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.831404 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.831564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.831716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.831868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.832023 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.832173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.832317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.832317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.833235 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.833235 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.833549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.833694 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.833852 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.834043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.834206 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.834358 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.834502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.834650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.834814 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.834814 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.835151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.835311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.835455 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.835607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.835753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.835909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.836053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.836203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.836353 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.836505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.836649 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.836800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.836952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.837104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.837257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.837415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.837566 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.837709 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.837850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.838067 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.838896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.839070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.839216 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.839368 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.839511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.839662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.839826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.839979 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.840130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.840276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.840427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.840579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.840732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.840877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.841028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.841172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.841315 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.841555 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.841722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.841878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.842080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.842243 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.842401 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.842545 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.842697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.842853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.842997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.843140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.843290 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.843443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.843596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.843740 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.843917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.844192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.844355 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.844521 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.844674 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.844828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.844980 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.845174 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.845324 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.845482 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.845482 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.845766 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.845966 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.846696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.846847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.846945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.847025 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.847107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.847181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.847273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.847362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.847446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.847520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.847597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.847677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.847771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.847861 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.847946 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.848041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.848121 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.848204 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.848296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.848379 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.848458 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.848530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.848610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.848690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.848760 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.848901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.848982 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.849062 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.849147 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.849232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.849232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.849393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.849393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.849546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.849635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.849724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.849817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.849905 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.849994 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.850128 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.850222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.850303 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.850394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.850476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.850567 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.850661 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.850753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.850837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.850928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.851012 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.851101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.851203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.851307 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.851399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.851483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.851565 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.851645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.851724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.851819 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.851905 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.851995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.852087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.852172 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.852257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.852358 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.852444 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.852534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.852618 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.852700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.852783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.852879 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.852972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.853071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.853157 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.853240 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.853342 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.853427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.853510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.853592 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.853683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.853772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.853870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.854068 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.854261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.854429 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.854578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.854723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.854878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.855026 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.855188 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.855394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.855549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.855694 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.855851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:17:54.856005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.856151 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.856305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.856456 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.856609 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.856754 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.856911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.857060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.857223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.857378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.857538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.857693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.857838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.857991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.858159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.858315 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.858470 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.859223 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.859880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.860048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.860217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.860374 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.860527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.860672 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.860823 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.860967 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.861110 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.861267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.861413 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.861556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.861724 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.862312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.862480 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.862652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.862804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.862947 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.863089 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.863241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.863386 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.863543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.863696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.863840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.863990 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.864135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.864291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.864445 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.864605 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.864750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.864901 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.865045 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.865202 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.865388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.865537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.865692 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.865836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.865987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.866242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.866395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.866561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.866714 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.866857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.867018 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.867172 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.867323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.867475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.867629 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.867773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.867773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.868055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.868055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.868442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.868604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.869168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.869454 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.870268 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.870449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.870620 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.870782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.870934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.871100 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.871258 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.871417 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.871576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.871735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.871926 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.872164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.872321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.872480 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.872630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.872799 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.872951 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.873113 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.873272 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.873433 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.873582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.873732 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.873950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.874150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.874301 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.874462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.874623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.874783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.874948 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.875106 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.875257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.875456 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.875618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.875769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.875928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.876087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.876256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.876415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.876572 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.876722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.876885 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.877041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.877262 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.877423 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.877579 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.877739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.877898 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.878087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.878255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.878416 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.878575 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.878735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.879320 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.879588 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.879788 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.879941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.880099 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.880283 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.880522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.880678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.880835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.881004 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.881156 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.881366 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.881531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.881683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.881839 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.881990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.882176 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.882415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.882578 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.882739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.882897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.883055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.883230 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.883384 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.883541 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.883700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.883859 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.884009 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.884172 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.884325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.884481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.884639 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.884789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.884946 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.885105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.885266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.885418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.885616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.885768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.885926 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.886134 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.886287 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.886437 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.886598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.886754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.886920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.887084 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.887245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.887394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.887543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.887700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.887863 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.888020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.888172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.888327 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.888486 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.888637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.888798 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.888972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.889602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.889862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.890047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.890217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.890379 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.890548 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.890796 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.890952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.891103 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.891266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.891426 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.891584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.891735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.891735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.892635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.892855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.893016 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.893174 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.893325 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.893482 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.893641 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.893804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.893963 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.894149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.894308 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.894459 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.894608 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.894817 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.894973 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.895133 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.895282 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.895432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.895640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.895795 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.895953 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.896102 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.896250 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.896399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.896557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.896718 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.896875 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.897036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.897185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.897342 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.897501 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.897652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.897838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.897990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.898188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.898340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.898498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.898649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.898809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.898958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.899114 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.899675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.899853 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.900090 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.900255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.900406 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.900564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.900730 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.900988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.901147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.901298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.901463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.901621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.901785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.901943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.902131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.902131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.902418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.902682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.902848 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.903000 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.903149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.903308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.903458 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.903629 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.904370 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.904537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.904703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.904863 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.905022 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.905249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.905420 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.905870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.906084 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.906245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.906420 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.906587 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.906745 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.906903 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.907057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.907214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.907365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.907529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.907680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.907830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.907979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.908136 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.908294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.908530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.908697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.908849 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.908998 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.909155 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.909315 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.909951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.910254 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.910411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.910562 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.910725 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.910886 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.911162 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.911328 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.911487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.911640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.911789 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.911952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.912104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.912261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.912419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.912569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.912837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.913007 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.913160 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.913322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.913480 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.913637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.913803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.913961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.914138 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.914301 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.914462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.914613 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.914779 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.914931 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.915082 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.915242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.915405 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.915555 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.915716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.915925 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.916090 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.916242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.916391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.916549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.916701 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.917080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.917246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.917398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.917548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.917727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.918922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919137 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919533 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919756 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919917 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.919996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920068 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920306 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920390 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920470 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920702 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920775 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920775 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.920975 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921134 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921279 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921429 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921588 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921661 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921740 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.921960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922094 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922702 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922773 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.922936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923075 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923155 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923228 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923371 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923720 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923840 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.923840 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924079 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924210 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924565 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.924931 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925017 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925209 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925696 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925791 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.925960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926065 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926353 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926438 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926614 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926708 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926796 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.926964 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927230 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927366 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927460 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927828 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.927920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928012 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928535 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928620 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928710 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.928994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929079 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929271 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929365 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929534 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929617 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929702 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.929945 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930170 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930848 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.930961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931085 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931343 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931433 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931517 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931710 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931889 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.931972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932350 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932622 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932891 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.932984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933077 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933162 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933352 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933495 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933585 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.933939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934134 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934303 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934461 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.934828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935090 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935358 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.935931 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936287 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936371 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936461 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936647 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936828 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.936912 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937010 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937517 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937792 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937886 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.937972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938389 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938736 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938823 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.938922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.939011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.939096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.939188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.939381 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.939493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.939762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.939865 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.940073 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.940172 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.940373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.940475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.940708 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.940803 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.941084 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.941227 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.941331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.941469 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.941588 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.941681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.941908 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.942070 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.942307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.942419 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.942607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.942707 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.943082 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.943832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.944014 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.944260 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.944369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.944510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.944648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.944839 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.945006 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.945163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.945310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.945488 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.945621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.945796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.945934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.946146 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.946276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.946443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.946638 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.946753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.946890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.947217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.947531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.947847 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.948151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.948444 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.948612 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.948767 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.948917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.949075 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.949235 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.949402 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.949554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.949712 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.949868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.950042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.950211 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.950390 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.950551 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.950710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.950861 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.951012 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.951178 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.951423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.951580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.951730 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.951897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.952049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.952208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.952361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.952524 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.952674 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.952832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.952982 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.953142 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.953293 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.953451 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.953708 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.953866 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.954045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.954216 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.954376 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.954528 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.954689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.954839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.954989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.955198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.955393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.955557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.955716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.955866 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.956028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.956225 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.956393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.956546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.956705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.956873 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.957035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.957201 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.957365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.957525 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.957676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.957839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.957997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.958197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.958360 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.958511 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.958670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.958832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.958991 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.959148 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.959299 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.959448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.959611 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.959772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.959923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.960072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.960221 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.960369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.960527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.960678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.960841 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.960999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.961149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.961308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.961499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.961653 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.961820 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.961978 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.962172 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.962341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.962492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.962642 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.962806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.962967 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.963125 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.963289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.963440 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.963599 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.963756 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.963915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.964068 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.964226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.964380 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.964537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.964695 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.964845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.965006 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.965171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.965323 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.965481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.965631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.965782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.965940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.966127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.966331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.966489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.966649 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.966807 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.966976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.966976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.967263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.967412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.967562 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.967711 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.967875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.968035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.968185 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.968345 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.968504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.968665 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.968816 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.968986 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.969145 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.969300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.969449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.969607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.969759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.969909 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.970114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.970282 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.970435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.970598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.970755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.970960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.971129 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.971280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.971431 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.971595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.971755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.971924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.972083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.972243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.972395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.972554 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.972706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.972857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.973017 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.973017 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.973313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.973473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.973624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.973774 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.973924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.974107 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.974272 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.974432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.974583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.974734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.974891 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.975051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.975217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.975419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.975583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.975741 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.975892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.976058 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.976217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.976410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.976574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.976727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.976992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.977173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.977338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.977490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.977649 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.977808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.977966 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.978196 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.978359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.978518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.978676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.978836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.978996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.979159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.979328 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.979486 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.979638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.979793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.979951 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.980103 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.980253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.980411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.980561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.980720 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.980881 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.981040 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.981201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.981351 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.981509 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.981673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.981839 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.981994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.982167 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.982318 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.982478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.982638 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.982797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.982949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.983099 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.983259 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.983410 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.983573 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.983732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.983890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.984049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.984208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.984358 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.984555 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.984709 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.984859 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.985009 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.985170 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.985329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.985482 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.985641 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.985794 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.985794 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.986124 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.986294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.986506 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.986667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.986815 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.987308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.987462 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.987636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.987827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.987990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.988142 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.988292 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.988449 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.988601 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.988760 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.988919 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.989077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.989228 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.989386 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.989558 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.989558 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.989869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.989869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.990215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.990215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.990524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.990693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.990902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.991053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.991258 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.991437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.991612 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.991842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.992028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.992187 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.992433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.992625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.992625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.992929 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.993156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.993392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.993600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.993755 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.993928 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.994159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.994367 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.994551 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.994551 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.994945 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.995112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.995289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.995488 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.995693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.995902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.996062 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.996284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.996498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.996714 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.996927 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.997081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.997239 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.997389 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.997539 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.997703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.997878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.998083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.998083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.998393 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.998576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.998576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.998958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.999178 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.999357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.999545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.999711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:54.999864 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.000028 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.000188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.000339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.000489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.000645 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.000877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.001032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.001202 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.001353 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.001512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.001719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.001931 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.002279 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.002487 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.002655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.002838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.002838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.003213 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.003412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.003638 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.003889 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.004060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.004243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.004453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.004615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.004766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.004917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.005067 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.005245 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.005435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.005590 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.005806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.005993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.006215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.006417 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.006716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.006897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.007093 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.007248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.007408 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.007561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.007717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.007875 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.008025 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.008198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.008373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.008556 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.008748 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.008966 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.009148 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.009333 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.009533 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.009696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.009857 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.010049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.010209 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.010372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.010546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.010706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.010860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.011010 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.011159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.011327 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.011478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.011627 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.011788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.011944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.012102 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.012268 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.012434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.012585 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.012743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.012894 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.012894 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.013188 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.013340 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.013497 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.013662 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.013814 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.013972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.014149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.014323 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.014484 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.014649 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.014801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.014963 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.015124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.015275 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.015425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.015574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.015723 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.015881 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.016033 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.016181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.016341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.016499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.016664 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.016860 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.017011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.017168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.017326 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.017477 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.017638 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.017811 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.017965 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.018153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.018315 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.018466 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.018621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.018716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.018716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.018858 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.018933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019006 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019090 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019254 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019413 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019506 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019581 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019653 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019726 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019882 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.019968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020042 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020203 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020283 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020617 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020773 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020859 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.020933 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021018 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021100 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021494 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021567 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021641 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021719 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021885 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.021964 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022315 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022389 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022493 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022585 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022909 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.022990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023062 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023379 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023461 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023535 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023606 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023677 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023917 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.023988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024067 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024217 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024303 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024397 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024586 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024780 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024867 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.024952 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025044 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025562 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025647 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025832 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.025927 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.026037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.026210 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.026380 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.026549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.026709 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.026919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.027083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.027243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.027395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.027553 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.027717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.027877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.028028 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.028203 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.028355 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.028504 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.028687 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.028843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.028993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.029143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.029292 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.029449 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.029613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.029765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.029923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.030101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.030265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.030415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.030582 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.030742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.030901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.031059 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.031218 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.031378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.031530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.031679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.031829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.031988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.032172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.032338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.032505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.032664 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.032815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.032972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.033131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.033291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.033497 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.033656 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.033816 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.033967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.034162 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.034265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.034405 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.034543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.034679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.034814 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.034958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.035097 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.035231 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.035404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.035540 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.035675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.035838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.036004 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.036164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.036330 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.036490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.036649 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.036809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.037000 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.037157 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.037307 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.037457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.037621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.037781 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.037943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.038135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.038298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.038495 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.038666 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.038818 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.038967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.039115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.039264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.039421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.039572 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.039730 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.039880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.040040 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.040198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.040356 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.040515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.040666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.040814 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.040962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.041112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.041275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.041434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.041586 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.041742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.041910 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.042094 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.042251 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.042400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.042550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.042706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120607) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 05:17:55.042864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.042864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.042864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.043299 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.043299 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.043586 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.043883 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.044187 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.044486 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.044783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.045087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.045384 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.045681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.045980 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.046305 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.046658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.046901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.047198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.047496 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.047793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.048091 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.048388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.048687 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.048984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.049328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.049626 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.049923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.050243 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.050568 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.050896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.051205 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.051520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.051825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.052141 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.052443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.052788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.053104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.053408 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.053709 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.054041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.054357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.054660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.054958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.055262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.055563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.055847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.056172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.056492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.056801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.057114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.057422 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.057735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.058068 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.058361 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.058688 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.058993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.059301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.059602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.059906 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.060210 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.060517 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.060820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.061122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.061431 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.061737 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.062077 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.062399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.062704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.063022 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.063342 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.063682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.063986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.064318 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.064676 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.064992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.065296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.065593 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:17:55.065831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 05:17:55.102108 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO dbcounter [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Registered counter for database nova_api Aug 31 05:17:55.122871 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_db.sqlalchemy.engines [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:17:55.126127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO dbcounter [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Registered counter for database nova_api Aug 31 05:17:55.129934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writer thread running {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:17:55.146377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:17:55.153349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writer thread running {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:17:55.185610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.context [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c5b09df-1bba-4015-8eaa-e92ec93ae071(cell1) {{(pid=120607) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 05:17:55.189662 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:17:55.190164 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:17:55.191731 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:17:55.192453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:17:55.192896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:17:55.194918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:17:55.196902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO dbcounter [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Registered counter for database nova_cell0 Aug 31 05:17:55.200964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO dbcounter [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Registered counter for database nova_cell1 Aug 31 05:17:55.207948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.context [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c5b09df-1bba-4015-8eaa-e92ec93ae071(cell1) {{(pid=120608) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 05:17:55.208545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_db.sqlalchemy.engines [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:17:55.210866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_db.sqlalchemy.engines [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:17:55.212048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:17:55.212523 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:17:55.214127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:17:55.214854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:17:55.215294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:17:55.215451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writer thread running {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:17:55.217262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:17:55.218414 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writer thread running {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:17:55.219294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO dbcounter [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Registered counter for database nova_cell0 Aug 31 05:17:55.223352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO dbcounter [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Registered counter for database nova_cell1 Aug 31 05:17:55.230691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:17:55.232402 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:17:55.238858 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writer thread running {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:17:55.240421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writer thread running {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:17:55.364382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO dbcounter [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Registered counter for database nova_cell0 Aug 31 05:17:55.371424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_db.sqlalchemy.engines [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120607) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:17:55.376331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writer thread running {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:17:55.384128 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO dbcounter [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Registered counter for database nova_cell0 Aug 31 05:17:55.391056 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:17:55.395890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writer thread running {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:17:55.689071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: WARNING keystonemiddleware.auth_token [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 05:17:55.696506 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: WARNING keystonemiddleware.auth_token [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 05:17:55.708030 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: WARNING keystonemiddleware.auth_token [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 05:17:55.715426 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: WARNING keystonemiddleware.auth_token [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 05:17:56.038684 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: WARNING keystonemiddleware.auth_token [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 05:17:56.044706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: WARNING keystonemiddleware.auth_token [None req-9f94237f-1841-4df1-b096-dfd34320aa60 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 05:17:56.050152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d10c8e9c0 pid: 120607 (default app) Aug 31 05:17:56.053423 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: WARNING keystonemiddleware.auth_token [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 05:17:56.059424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: WARNING keystonemiddleware.auth_token [None req-7a4f6451-26c1-46ae-b4f7-a9ddbca92858 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 05:17:56.064715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d10c8e9c0 pid: 120608 (default app) Aug 31 05:18:31.233829 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:31.234822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:31.235737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:31.236856 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:32.696509 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:32.698069 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:32.700973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:32.702830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:32.973269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4686f223-906b-4431-8a11-822d57099af2 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Action: 'create', calling method: .version_select at 0x7fbd0c315e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-897702530"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:33.974735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-84ab4cbc-69d9-4c4a-89b0-15a3d615bb3f tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Action: 'create', calling method: .version_select at 0x7fbd0c317e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1307419974", "metadata": {"Type": "work"}}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:35.756173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4686f223-906b-4431-8a11-822d57099af2 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.531728 Aug 31 05:18:35.756834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Aug 31 05:18:31 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4534 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 05:18:35.774949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3a855f78-dcd2-4e1e-9cdc-176b244261b7 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c195ca0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:35.964485 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-84ab4cbc-69d9-4c4a-89b0-15a3d615bb3f tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.290521 Aug 31 05:18:35.974200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Aug 31 05:18:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3296 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 05:18:35.980199 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-48e29433-6cb5-4ab3-a9a9-1a2c36ef9bac tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Calling method '.version_select at 0x7fbd0c19aca0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:36.078666 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3a855f78-dcd2-4e1e-9cdc-176b244261b7 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 200 len: 344 microversion: 2.1 time: 0.308282 Aug 31 05:18:36.079470 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:35 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 344 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:36.200803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-48e29433-6cb5-4ab3-a9a9-1a2c36ef9bac tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac" status: 200 len: 353 microversion: 2.1 time: 0.225075 Aug 31 05:18:36.201639 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:35 2022] GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac => generated 353 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:18:37.098345 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2afb481f-45ed-4bc0-8b4e-aede624d38a8 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c1ae3a0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:37.219578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d8d5f956-9e42-4a61-a8a5-c15d00cd746f tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Calling method '.version_select at 0x7fbd0c1b03a0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:37.342131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d8d5f956-9e42-4a61-a8a5-c15d00cd746f tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac" status: 200 len: 354 microversion: 2.1 time: 0.129925 Aug 31 05:18:37.350383 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:37 2022] GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:18:37.355796 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-232efc89-2c24-4df6-9721-ad3c4ff03d38 tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Calling method '.version_select at 0x7fbd0c1b0af0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:37.392850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2afb481f-45ed-4bc0-8b4e-aede624d38a8 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 200 len: 345 microversion: 2.1 time: 0.303585 Aug 31 05:18:37.393728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:37 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 345 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:37.407796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-33bd166e-4c23-4d50-98fb-cfe369c5a821 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Action: 'create', calling method: .version_select at 0x7fbd0c1ae9d0>, body: {"snapshot": {"volume_id": "eaffe24f-04a8-4f77-a11c-02ceab4eb939", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-183358715"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:37.437234 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-232efc89-2c24-4df6-9721-ad3c4ff03d38 tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac" status: 200 len: 354 microversion: 2.1 time: 0.085680 Aug 31 05:18:37.448224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:37 2022] GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:37.454192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0ea90267-b9f7-4703-834b-8bb624f56e2b tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Calling method '.version_select at 0x7fbd0c19aca0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:37.579047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0ea90267-b9f7-4703-834b-8bb624f56e2b tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac" status: 202 len: 0 microversion: 2.1 time: 0.115855 Aug 31 05:18:37.586382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:18:37 2022] DELETE /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:18:37.610107 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7151a925-074d-42fa-85b1-20142a644630 tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Calling method '.version_select at 0x7fbd0c1b0b80>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:37.727841 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7151a925-074d-42fa-85b1-20142a644630 tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac" status: 200 len: 353 microversion: 2.1 time: 0.126043 Aug 31 05:18:37.733808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 6/9] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:37 2022] GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:37.850133 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-33bd166e-4c23-4d50-98fb-cfe369c5a821 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.447141 Aug 31 05:18:37.850722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 4/10] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Aug 31 05:18:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:37.862514 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c3c5ff8a-470c-4ddf-aa28-8f2f013f94fb tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c1b03a0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:37.931484 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c3c5ff8a-470c-4ddf-aa28-8f2f013f94fb tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 286 microversion: 2.1 time: 0.073336 Aug 31 05:18:37.932531 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 7/11] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:37 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:37.946892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ca5ad67b-411c-4049-bcb1-861643425bfc tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c1aed30>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:38.045787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ca5ad67b-411c-4049-bcb1-861643425bfc tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.103347 Aug 31 05:18:38.046905 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 5/12] 10.222.0.36 () {58 vars in 1140 bytes} [Wed Aug 31 05:18:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:38.059940 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6ef8d7d0-d8e1-4ec2-b8ae-a849b384c3ae tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c1b00d0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:38.134529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6ef8d7d0-d8e1-4ec2-b8ae-a849b384c3ae tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 286 microversion: 2.1 time: 0.080147 Aug 31 05:18:38.135111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 8/13] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:38 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:38.747647 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e2da4f5c-5be8-46f8-aeb6-9f180339043c tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Calling method '.version_select at 0x7fbd0c315f70>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:38.798175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-e2da4f5c-5be8-46f8-aeb6-9f180339043c tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] HTTP exception thrown: Volume 98ee1a55-7639-48a2-8803-b11f7da86bac could not be found. Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e2da4f5c-5be8-46f8-aeb6-9f180339043c tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Request method failure captured: Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac HTTP/1.1 Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu8o-LU_mGzJD5Sihry3bZivFJ4h1RitD50NecJU2aWWT7jNJ5whswRU2usxueqdOp3SVyF3f8HPCvHGGLAaMgC0yfuyBFnD8HGohxZuNn1EG9RII9aHYrGLD6X2aznhR1KZQ19XNbgJj68AJxonb9ewAoHDIu8iBYimfuckqCJvTQk Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 7c7f893cbdb04887bfc04fcc56da939e Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-VolumesGetTestJSON-1779089695 Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:18:38.804337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7c7f893cbdb04887bfc04fcc56da939e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7c7f893cbdb04887bfc04fcc56da939e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7c7f893cbdb04887bfc04fcc56da939e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7c7f893cbdb04887bfc04fcc56da939e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-VolumesGetTestJSON-1779089695 Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 7c7f893cbdb04887bfc04fcc56da939e Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-VolumesGetTestJSON-1779089695 Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-VolumesGetTestJSON-1779089695-project Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: fd7ec99ba8e0464d98840d5f4a38417e Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-VolumesGetTestJSON-1779089695-project Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Volume 98ee1a55-7639-48a2-8803-b11f7da86bac could not be found. Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '98ee1a55-7639-48a2-8803-b11f7da86bac'} Aug 31 05:18:38.805489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98ee1a55-7639-48a2-8803-b11f7da86bac could not be found. (HTTP 404) (Request-ID: req-5a5a4d79-9496-44a2-ba20-47deae158a25) Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:38.806273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:18:38.807223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98ee1a55-7639-48a2-8803-b11f7da86bac could not be found. Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 05:18:38.808224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98ee1a55-7639-48a2-8803-b11f7da86bac could not be found. Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98ee1a55-7639-48a2-8803-b11f7da86bac could not be found. Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:38.809184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e2da4f5c-5be8-46f8-aeb6-9f180339043c tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] Returning 404 to user: Volume 98ee1a55-7639-48a2-8803-b11f7da86bac could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:18:38.809804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e2da4f5c-5be8-46f8-aeb6-9f180339043c tempest-VolumesGetTestJSON-1779089695 tempest-VolumesGetTestJSON-1779089695-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac" status: 404 len: 109 microversion: 2.1 time: 0.066009 Aug 31 05:18:38.810059 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 6/14] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:38 2022] GET /compute/v2.1/os-volumes/98ee1a55-7639-48a2-8803-b11f7da86bac => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:18:39.154385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-97469dbd-dce8-407b-9c05-9c43ffbf0c60 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c1b0a60>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:39.276026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-97469dbd-dce8-407b-9c05-9c43ffbf0c60 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 286 microversion: 2.1 time: 0.125322 Aug 31 05:18:39.276828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 9/15] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:39 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:40.288597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7e9cf6fd-58fa-41e2-b962-a6e22a50150a tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c1374c0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:40.350975 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7e9cf6fd-58fa-41e2-b962-a6e22a50150a tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 286 microversion: 2.1 time: 0.066058 Aug 31 05:18:40.351555 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 7/16] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:40 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:41.363694 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-52bf522a-4cce-4a47-a159-5bb8fa3f512a tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c137c10>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:41.462249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-52bf522a-4cce-4a47-a159-5bb8fa3f512a tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 286 microversion: 2.1 time: 0.102515 Aug 31 05:18:41.463047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 8/17] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:41 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:18:41.697678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1249745622", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "networks": [{"uuid": "23732caa-8c1d-4b99-85b5-80b02d9c87c0"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:41.971120 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] validate_networks() for [('23732caa-8c1d-4b99-85b5-80b02d9c87c0', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:18:42.474179 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-334c9a9e-91f6-438e-9160-27bfe91699eb tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c137ca0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:42.528539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-334c9a9e-91f6-438e-9160-27bfe91699eb tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 286 microversion: 2.1 time: 0.057688 Aug 31 05:18:42.529542 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:42 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:18:43.542531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-25a4c5c1-3cc7-4af8-b93b-c1b2aafc94d0 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c1374c0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:43.616920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-25a4c5c1-3cc7-4af8-b93b-c1b2aafc94d0 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 286 microversion: 2.1 time: 0.078550 Aug 31 05:18:43.622071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:43 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:44.630025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7beeed36-f145-4de0-a720-60146bcdbbe3 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c11c3a0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:44.699570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7beeed36-f145-4de0-a720-60146bcdbbe3 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 287 microversion: 2.1 time: 0.074463 Aug 31 05:18:44.700154 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:44 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:44.947261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:18:44.947800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:18:44.948139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:18:44.948520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:18:44.948922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:18:45.017445 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:45.017938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:45.022920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:45.030350 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:45.030836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:45.031263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:45.151446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Getting quotas for project 44a0d4c08d8044b1ab696dc757ba1a4d. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:18:45.166202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Getting quotas for user 69e6e2487fce4c03a8770443791c5b8a and project 44a0d4c08d8044b1ab696dc757ba1a4d. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:18:45.188544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:18:45.197874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:18:45.364974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f5a8c28f-e55d-49b7-a7b1-814f3bcbc2d9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'create', calling method: .version_select at 0x7fbd0c137430>, body: {"keypair": {"name": "tempest-keypair-1596219754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUsSVTnLmhhvDAiqwfOwwRKWGJuEcVxbmTny5Ocj4VC2BxY9afRz6RuQFZtyQSOrnNbjlx8MQJX7lR37KwHUqygH7h369CB68nnbGFSrO7Il/Kbsk5QNR/UxRokl4f5Zw=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:45.383835 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eec07b77-04f3-467a-8fca-0e0ebb07549c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.217533 Aug 31 05:18:45.386087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 10/21] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:18:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:18:45.401063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5ca9c776-e980-462b-a2b6-612c0ee21be5 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0b8399d0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:45.487130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-f5a8c28f-e55d-49b7-a7b1-814f3bcbc2d9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Getting quotas for project 14058365e648441d96bb725c33f80923. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:18:45.497515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-f5a8c28f-e55d-49b7-a7b1-814f3bcbc2d9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Getting quotas for user 4b07cff5bc3a4e68b62c4c5d3e798732 and project 14058365e648441d96bb725c33f80923. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:18:45.624382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5ca9c776-e980-462b-a2b6-612c0ee21be5 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 202 len: 0 microversion: 2.1 time: 0.227496 Aug 31 05:18:45.624958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1254 bytes} [Wed Aug 31 05:18:45 2022] DELETE /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:18:45.632569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b62d4ea9-413e-4e56-beec-55c5cbfe6d83 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:45.637305 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b62d4ea9-413e-4e56-beec-55c5cbfe6d83 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:45.643399 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f5a8c28f-e55d-49b7-a7b1-814f3bcbc2d9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.941656 Aug 31 05:18:45.648005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 12/23] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:18:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:45.664533 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fa5d4fa7-ca3d-42a9-94ee-47d28dd41ab7 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c0804c0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:45.811275 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fa5d4fa7-ca3d-42a9-94ee-47d28dd41ab7 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 200 len: 286 microversion: 2.1 time: 0.162082 Aug 31 05:18:45.812115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 13/24] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:45 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:45.964885 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b62d4ea9-413e-4e56-beec-55c5cbfe6d83 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:45.998421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b62d4ea9-413e-4e56-beec-55c5cbfe6d83 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1215 microversion: 2.1 time: 0.370764 Aug 31 05:18:46.009613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 12/25] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:45 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1215 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:46.280185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-271a227b-1b20-47da-8e2e-6c21095ae01b tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0c037160>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:46.467925 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-271a227b-1b20-47da-8e2e-6c21095ae01b tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6d37f6f8-d767-4b00-9c72-443525a0e106" status: 200 len: 350 microversion: 2.1 time: 0.185020 Aug 31 05:18:46.470200 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 14/26] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:46 2022] GET /compute/v2.1/os-volumes/6d37f6f8-d767-4b00-9c72-443525a0e106 => generated 350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:46.828414 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b00242a9-8e86-4da5-a035-32fc7fe39ca6 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0b853dc0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:46.990478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-b00242a9-8e86-4da5-a035-32fc7fe39ca6 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] HTTP exception thrown: Snapshot fe3baadc-8728-4e9f-b49c-bb71e051de80 could not be found. Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b00242a9-8e86-4da5-a035-32fc7fe39ca6 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Request method failure captured: Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 HTTP/1.1 Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu8nqKBjBwXt1Gg7Aez0ZnQeY8CmjK9aY50qFkyps3RKZtro-Gi7sOuGgCOqGLyZfy7qp4uMh7WQHjifJu-9uSL2cTS4VGxqANJnBsvnW-HCag9NskcIKz7oONeyYwAlChKM57VgUEk5CkXGEO0dhIzgtUAKz3omlysjZXVIlJMc61k Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 8ae84d5c59f0431887b06223cb120691 Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:18:46.998377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ae84d5c59f0431887b06223cb120691", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 8ae84d5c59f0431887b06223cb120691 Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotsTestJSON-1016816058-project Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 9a56feccbe844aff84e2b35a179a9e16 Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1016816058-project Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Snapshot fe3baadc-8728-4e9f-b49c-bb71e051de80 could not be found. Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'fe3baadc-8728-4e9f-b49c-bb71e051de80'} Aug 31 05:18:46.999602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fe3baadc-8728-4e9f-b49c-bb71e051de80 could not be found. (HTTP 404) (Request-ID: req-449fec38-553f-4df3-a04e-4af6e7139d00) Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:47.000520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:18:47.002254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fe3baadc-8728-4e9f-b49c-bb71e051de80 could not be found. Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 05:18:47.004537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fe3baadc-8728-4e9f-b49c-bb71e051de80 could not be found. Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fe3baadc-8728-4e9f-b49c-bb71e051de80 could not be found. Aug 31 05:18:47.005583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:47.010540 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b00242a9-8e86-4da5-a035-32fc7fe39ca6 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Returning 404 to user: Snapshot fe3baadc-8728-4e9f-b49c-bb71e051de80 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:18:47.011729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b00242a9-8e86-4da5-a035-32fc7fe39ca6 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80" status: 404 len: 111 microversion: 2.1 time: 0.190683 Aug 31 05:18:47.018751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 13/27] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:18:46 2022] GET /compute/v2.1/os-snapshots/fe3baadc-8728-4e9f-b49c-bb71e051de80 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:18:47.023678 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4c9a3138-0ace-49a2-9415-5ce8eb5f94dc tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c0378b0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:47.035581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-34610fd6-0fbf-4eca-8bbf-82cd4ac00b87 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:47.045064 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-34610fd6-0fbf-4eca-8bbf-82cd4ac00b87 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:47.216977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4c9a3138-0ace-49a2-9415-5ce8eb5f94dc tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 202 len: 0 microversion: 2.1 time: 0.198720 Aug 31 05:18:47.217800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:18:47 2022] DELETE /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:18:47.225565 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8e516b49-6575-45bc-8c5b-e174e51a2e67 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c080d30>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:47.331416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8e516b49-6575-45bc-8c5b-e174e51a2e67 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 200 len: 344 microversion: 2.1 time: 0.109433 Aug 31 05:18:47.332321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:47 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:18:47.336843 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-34610fd6-0fbf-4eca-8bbf-82cd4ac00b87 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:47.348598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-34610fd6-0fbf-4eca-8bbf-82cd4ac00b87 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1215 microversion: 2.1 time: 0.323595 Aug 31 05:18:47.366915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 14/30] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:47 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:48.345916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-569cfe9a-95e8-4399-9457-76121eb4f0d3 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c080af0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:48.381631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:48.387740 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:48.410773 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:48.412791 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:48.415241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:48.418518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:48.421671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:48.423706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:48.523027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-569cfe9a-95e8-4399-9457-76121eb4f0d3 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 200 len: 344 microversion: 2.1 time: 0.180994 Aug 31 05:18:48.530816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 17/31] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:48 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:48.750307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:48.776930 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-78a6bee0-c50b-42dc-9650-2acc5773aba4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1219 microversion: 2.1 time: 0.407644 Aug 31 05:18:48.790688 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 15/32] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:48 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1219 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:49.008713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9145abb2-afe4-4d6d-ae8a-e69d77a5776a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'create', calling method: .version_select at 0x7fbd0c0375e0>, body: {"keypair": {"name": "tempest-keypair-475708473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo4HU8mOt45As9jJoVHXQBKZpNthL7+8cO/J+M3F1WBB1TPV7X1PK1uv8EyXA2IXUeTw+AcSAbq0oV5KG0uIJDs+a8FUDQr8HDR3ebtJuOK48dr7d8NwcQTc7kdUWDVGw=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:49.045846 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-9145abb2-afe4-4d6d-ae8a-e69d77a5776a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Getting quotas for project 164c57b95c274f89bd391cf111efa374. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:18:49.062293 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-9145abb2-afe4-4d6d-ae8a-e69d77a5776a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Getting quotas for user af50ca6347404cdf8eb213d27053af16 and project 164c57b95c274f89bd391cf111efa374. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:18:49.116793 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9145abb2-afe4-4d6d-ae8a-e69d77a5776a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.575841 Aug 31 05:18:49.117408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 18/33] 10.222.0.36 () {62 vars in 1200 bytes} [Wed Aug 31 05:18:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 577 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 05:18:49.499166 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1021205548", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd8d1fc4-2d2b-4e66-9d1f-cafce5280c0d"}], "security_groups": [{"name": "tempest-securitygroup--109101784"}], "key_name": "tempest-keypair-1596219754", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:49.539311 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-73e80b46-b5b6-45a1-9ff9-6c857d00a074 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c037940>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:49.621611 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-73e80b46-b5b6-45a1-9ff9-6c857d00a074 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 200 len: 344 microversion: 2.1 time: 0.086755 Aug 31 05:18:49.625052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 19/34] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:49 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:49.771544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] validate_networks() for [('dd8d1fc4-2d2b-4e66-9d1f-cafce5280c0d', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:18:49.798049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:49.798792 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:49.828508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:49.829007 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:49.829432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:49.851224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:49.851991 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:49.852415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:50.223392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:50.263500 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b626a77d-58d3-4f0c-aff4-0475cace74db tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1219 microversion: 2.1 time: 0.469330 Aug 31 05:18:50.265919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 20/35] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:49 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1219 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:18:50.644991 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7f2e04e4-8438-4d33-9005-b5ad0df6361f tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0bfc7d30>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:50.669613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:18:50.670176 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:18:50.670512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:18:50.670916 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:18:50.671313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:18:50.684504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:50.684983 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:50.685409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:50.687036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:50.687857 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:50.688430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:50.708173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Getting quotas for project 14058365e648441d96bb725c33f80923. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:18:50.713280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Getting quotas for user 4b07cff5bc3a4e68b62c4c5d3e798732 and project 14058365e648441d96bb725c33f80923. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:18:50.727598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:18:50.730530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:18:50.759421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7f2e04e4-8438-4d33-9005-b5ad0df6361f tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 200 len: 344 microversion: 2.1 time: 0.124156 Aug 31 05:18:50.760294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 21/36] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:50 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:18:50.805622 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0f4b7159-de73-4fd2-be3d-85db78d093fe tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.312063 Aug 31 05:18:50.819619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 16/37] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:18:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:18:50.819836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ab8fd633-4dc0-4bb0-a3da-8981d1f4e551 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:50.820290 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ab8fd633-4dc0-4bb0-a3da-8981d1f4e551 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:51.015576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ab8fd633-4dc0-4bb0-a3da-8981d1f4e551 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:51.057104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ab8fd633-4dc0-4bb0-a3da-8981d1f4e551 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1238 microversion: 2.1 time: 0.239086 Aug 31 05:18:51.062265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 22/38] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:50 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1238 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:18:51.287028 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:51.287626 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:51.294442 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:51.294956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:51.295353 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:51.301684 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:51.307235 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:51.308001 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:51.506567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:51.530487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8fc4f445-a803-429a-b20f-05252a224b1d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1211 microversion: 2.1 time: 0.247541 Aug 31 05:18:51.543828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 17/39] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:51 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1211 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:51.780232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e4a68163-5c07-4eb2-ba0a-4e9256d7a8cd tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0c0804c0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:51.891396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e4a68163-5c07-4eb2-ba0a-4e9256d7a8cd tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 200 len: 344 microversion: 2.1 time: 0.121040 Aug 31 05:18:51.892054 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 23/40] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:51 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:52.083619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8b4973b6-1107-4669-9e63-d3e4a00b8ab3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:52.085701 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8b4973b6-1107-4669-9e63-d3e4a00b8ab3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:52.166993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8b4973b6-1107-4669-9e63-d3e4a00b8ab3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:52.180079 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8b4973b6-1107-4669-9e63-d3e4a00b8ab3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1238 microversion: 2.1 time: 0.105081 Aug 31 05:18:52.188489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 18/41] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:52 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:52.188666 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-278707612", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b1ab71e-eadb-41b5-9cb1-69b3694afd1a"}], "security_groups": [{"name": "tempest-securitygroup--984596307"}], "key_name": "tempest-keypair-475708473", "user_data": "}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:52.469319 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.network.neutron [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] validate_networks() for [('2b1ab71e-eadb-41b5-9cb1-69b3694afd1a', None, None, None, None, None)] {{(pid=120607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:18:52.553257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:52.553974 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:52.574968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:52.575560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:52.581269 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:52.582326 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:52.593879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:52.596242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:52.897797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:52.908596 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8ece449e-e5bd-4ae2-ad92-eb882625daef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1275 microversion: 2.1 time: 0.359215 Aug 31 05:18:52.910369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 19/42] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:52 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:52.926977 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-46ce0a05-6782-4630-b66b-ba50b616e4f0 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0b6f9af0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:53.826577 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-46ce0a05-6782-4630-b66b-ba50b616e4f0 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/3a3fb631-2241-44bc-a33d-4b55d745639d" status: 200 len: 351 microversion: 2.1 time: 0.915106 Aug 31 05:18:53.827495 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 20/43] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:52 2022] GET /compute/v2.1/os-volumes/3a3fb631-2241-44bc-a33d-4b55d745639d => generated 351 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:53.832441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-624c94ea-9950-4ce6-928f-4e8301c47899 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0b725670>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:54.145577 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-624c94ea-9950-4ce6-928f-4e8301c47899 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] HTTP exception thrown: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-624c94ea-9950-4ce6-928f-4e8301c47899 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Request method failure captured: Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 HTTP/1.1 Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu8nqKBjBwXt1Gg7Aez0ZnQeY8CmjK9aY50qFkyps3RKZtro-Gi7sOuGgCOqGLyZfy7qp4uMh7WQHjifJu-9uSL2cTS4VGxqANJnBsvnW-HCag9NskcIKz7oONeyYwAlChKM57VgUEk5CkXGEO0dhIzgtUAKz3omlysjZXVIlJMc61k Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 8ae84d5c59f0431887b06223cb120691 Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:18:54.148872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ae84d5c59f0431887b06223cb120691", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 8ae84d5c59f0431887b06223cb120691 Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotsTestJSON-1016816058-project Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 9a56feccbe844aff84e2b35a179a9e16 Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1016816058-project Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'eaffe24f-04a8-4f77-a11c-02ceab4eb939'} Aug 31 05:18:54.150038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. (HTTP 404) (Request-ID: req-9752f58a-5816-44e2-8024-c767f6b13582) Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:54.150743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:18:54.152212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 05:18:54.153412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-624c94ea-9950-4ce6-928f-4e8301c47899 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Returning 404 to user: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:18:54.155178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-624c94ea-9950-4ce6-928f-4e8301c47899 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 404 len: 109 microversion: 2.1 time: 0.322105 Aug 31 05:18:54.161097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 21/44] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:53 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 109 bytes in 333 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:18:54.176032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:54.176521 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:54.195916 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:54.196415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:54.196850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:54.197579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:54.206378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:54.206928 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:54.723249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Flavor limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:18:54.723851 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Image limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:18:54.724120 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Flavor pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:18:54.724693 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Image pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:18:54.725915 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:18:54.753879 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:54.756396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:54.757830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:54.761231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:54.761799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:54.763425 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:54.856978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Getting quotas for project 164c57b95c274f89bd391cf111efa374. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:18:54.865144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Getting quotas for user af50ca6347404cdf8eb213d27053af16 and project 164c57b95c274f89bd391cf111efa374. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:18:54.883528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Going to run 1 instances... {{(pid=120607) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:18:54.887462 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:18:54.927629 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:54.943653 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0d7556cd-68b4-44cf-9bcb-78a8ae2f4a01 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1296 microversion: 2.1 time: 0.781217 Aug 31 05:18:54.948270 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 22/45] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:54 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1296 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:54.964401 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:54.967721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:54.988927 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:54.998350 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:54.998785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:55.000470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:55.004016 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:55.013413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:55.028746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-97b161b6-0353-48c0-b807-8defe698df09 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.848505 Aug 31 05:18:55.040252 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 24/46] 10.222.0.36 () {62 vars in 1188 bytes} [Wed Aug 31 05:18:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2861 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 05:18:55.061864 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f0fe7ddd-f612-4abc-8d26-bae4059aa451 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0bf1bd30>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:55.150263 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-f0fe7ddd-f612-4abc-8d26-bae4059aa451 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] HTTP exception thrown: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f0fe7ddd-f612-4abc-8d26-bae4059aa451 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Request method failure captured: Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 HTTP/1.1 Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu8nqKBjBwXt1Gg7Aez0ZnQeY8CmjK9aY50qFkyps3RKZtro-Gi7sOuGgCOqGLyZfy7qp4uMh7WQHjifJu-9uSL2cTS4VGxqANJnBsvnW-HCag9NskcIKz7oONeyYwAlChKM57VgUEk5CkXGEO0dhIzgtUAKz3omlysjZXVIlJMc61k Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 8ae84d5c59f0431887b06223cb120691 Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:18:55.152493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ae84d5c59f0431887b06223cb120691", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 8ae84d5c59f0431887b06223cb120691 Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-VolumesSnapshotsTestJSON-1016816058-project Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 9a56feccbe844aff84e2b35a179a9e16 Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1016816058-project Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': 'eaffe24f-04a8-4f77-a11c-02ceab4eb939'} Aug 31 05:18:55.153762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. (HTTP 404) (Request-ID: req-d40676bf-fc9e-462d-a5a8-4e1c8dc0af69) Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:55.154597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 05:18:55.155616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 05:18:55.157938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.159779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.161882 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f0fe7ddd-f612-4abc-8d26-bae4059aa451 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Returning 404 to user: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:18:55.164990 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f0fe7ddd-f612-4abc-8d26-bae4059aa451 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 404 len: 109 microversion: 2.1 time: 0.122776 Aug 31 05:18:55.166045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 25/47] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:18:55 2022] DELETE /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:18:55.176176 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2d429873-9ce0-4e90-822d-23ee8f65b1bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:55.179814 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2d429873-9ce0-4e90-822d-23ee8f65b1bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:55.501342 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2d429873-9ce0-4e90-822d-23ee8f65b1bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:55.512104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2d429873-9ce0-4e90-822d-23ee8f65b1bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:55.513838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2d429873-9ce0-4e90-822d-23ee8f65b1bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:55.519426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2d429873-9ce0-4e90-822d-23ee8f65b1bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1280 microversion: 2.20 time: 0.352119 Aug 31 05:18:55.520264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 26/48] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:18:55 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1280 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:18:55.530151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9d63efc7-b9e1-45d3-b07e-9dbd12389539 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Calling method '.version_select at 0x7fbd0bf313a0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:55.660436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-9d63efc7-b9e1-45d3-b07e-9dbd12389539 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] HTTP exception thrown: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9d63efc7-b9e1-45d3-b07e-9dbd12389539 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Request method failure captured: Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 HTTP/1.1 Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu8nqKBjBwXt1Gg7Aez0ZnQeY8CmjK9aY50qFkyps3RKZtro-Gi7sOuGgCOqGLyZfy7qp4uMh7WQHjifJu-9uSL2cTS4VGxqANJnBsvnW-HCag9NskcIKz7oONeyYwAlChKM57VgUEk5CkXGEO0dhIzgtUAKz3omlysjZXVIlJMc61k Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 8ae84d5c59f0431887b06223cb120691 Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:18:55.664903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8ae84d5c59f0431887b06223cb120691", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8ae84d5c59f0431887b06223cb120691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 8ae84d5c59f0431887b06223cb120691 Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1016816058 Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-VolumesSnapshotsTestJSON-1016816058-project Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 9a56feccbe844aff84e2b35a179a9e16 Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1016816058-project Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': 'eaffe24f-04a8-4f77-a11c-02ceab4eb939'} Aug 31 05:18:55.666498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. (HTTP 404) (Request-ID: req-3e19b82d-9b30-4fe8-92df-750de2d3b4c1) Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:55.667400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:18:55.668428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 05:18:55.669348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. Aug 31 05:18:55.670344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:18:55.673684 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9d63efc7-b9e1-45d3-b07e-9dbd12389539 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] Returning 404 to user: Volume eaffe24f-04a8-4f77-a11c-02ceab4eb939 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:18:55.674655 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9d63efc7-b9e1-45d3-b07e-9dbd12389539 tempest-VolumesSnapshotsTestJSON-1016816058 tempest-VolumesSnapshotsTestJSON-1016816058-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939" status: 404 len: 109 microversion: 2.1 time: 0.153270 Aug 31 05:18:55.675311 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 27/49] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:55 2022] GET /compute/v2.1/os-volumes/eaffe24f-04a8-4f77-a11c-02ceab4eb939 => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:18:55.696318 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6af0005d-6f25-4186-bbde-54878a49793c tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0b6b5670>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:55.821815 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6af0005d-6f25-4186-bbde-54878a49793c tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/5700e15d-8be7-4ea8-8c5a-49487c06383a" status: 200 len: 351 microversion: 2.1 time: 0.145133 Aug 31 05:18:55.830208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 28/50] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:18:55 2022] GET /compute/v2.1/os-volumes/5700e15d-8be7-4ea8-8c5a-49487c06383a => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:55.838046 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f95978c7-74cf-448c-b2ce-70aad50e86fe tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0bf31d30>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:55.959410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:55.981180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-162ef7bc-088a-42f7-a967-a5e7c324c009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 1.029889 Aug 31 05:18:55.988078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 23/51] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:54 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:55.993089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:55.993692 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:56.016038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:56.016522 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:56.016958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:56.017664 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:56.018815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:56.019327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:56.062909 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f95978c7-74cf-448c-b2ce-70aad50e86fe tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.229491 Aug 31 05:18:56.063732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 29/52] 10.222.0.36 () {58 vars in 1134 bytes} [Wed Aug 31 05:18:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:56.091157 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a6415bab-b836-4f65-98ca-3801206b2410 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0c037f70>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:56.296264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a6415bab-b836-4f65-98ca-3801206b2410 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.222619 Aug 31 05:18:56.296888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 30/53] 10.222.0.36 () {58 vars in 1149 bytes} [Wed Aug 31 05:18:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:18:56.315581 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-44cb832e-1eac-49c8-804c-8fdda0164d71 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0b6b5ee0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:56.339306 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:56.352918 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-35dffcc1-0a67-4532-bf49-a07f29115534 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1296 microversion: 2.1 time: 0.363575 Aug 31 05:18:56.354633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 24/54] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:55 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1296 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:56.545530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:56.546275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:56.547545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-44cb832e-1eac-49c8-804c-8fdda0164d71 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.241023 Aug 31 05:18:56.548680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 31/55] 10.222.0.36 () {58 vars in 1134 bytes} [Wed Aug 31 05:18:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:56.563396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-35a539ef-a49f-4994-ab43-f93ee36248e2 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0c1aeca0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:56.580014 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:56.582288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:56.584817 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:56.587664 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:56.590450 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:56.593194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:56.779326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-35a539ef-a49f-4994-ab43-f93ee36248e2 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.221291 Aug 31 05:18:56.780186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 32/56] 10.222.0.36 () {58 vars in 1167 bytes} [Wed Aug 31 05:18:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:18:56.795715 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0f1bd75c-ed65-437c-b584-4a11af96c980 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0bf31940>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:56.985027 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:56.986467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0f1bd75c-ed65-437c-b584-4a11af96c980 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.195249 Aug 31 05:18:56.996023 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:56.996408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 33/57] 10.222.0.36 () {58 vars in 1170 bytes} [Wed Aug 31 05:18:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:56.998133 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:57.003960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6a11226b-ba70-41f7-a74d-4ce523f3007d tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0b6cbdc0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:57.005584 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e5ec67fe-c1f2-4fb2-977d-6a01dcb28e4d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1284 microversion: 2.20 time: 0.466535 Aug 31 05:18:57.006759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 25/58] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:18:56 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1284 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:18:57.037131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:57.042242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:57.064334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:57.065292 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:57.065919 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:57.068516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:57.072171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:57.073045 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:57.214805 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6a11226b-ba70-41f7-a74d-4ce523f3007d tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.217062 Aug 31 05:18:57.224679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 34/59] 10.222.0.36 () {58 vars in 1155 bytes} [Wed Aug 31 05:18:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:57.230393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-55fa7e4d-28fa-4f54-a295-7a7bb8a12bd5 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0bf318b0>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:57.339854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-55fa7e4d-28fa-4f54-a295-7a7bb8a12bd5 tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.113519 Aug 31 05:18:57.340455 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 35/60] 10.222.0.36 () {58 vars in 1188 bytes} [Wed Aug 31 05:18:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:57.358183 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-42985f25-8f94-4754-8908-0b8bbb0740cd tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] Calling method '.version_select at 0x7fbd0c037f70>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:57.505177 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-42985f25-8f94-4754-8908-0b8bbb0740cd tempest-VolumesTestJSON-204053862 tempest-VolumesTestJSON-204053862-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.152937 Aug 31 05:18:57.514532 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 36/61] 10.222.0.36 () {58 vars in 1155 bytes} [Wed Aug 31 05:18:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:57.520911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:57.522994 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:57.543805 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:57.545377 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:57.546066 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:57.547445 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:57.548943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:57.550108 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:57.572049 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:57.582841 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8d2e2b67-4c1a-46f5-9b6c-46614c60f009 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.551573 Aug 31 05:18:57.583775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 26/62] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:57 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:57.689187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:57.707452 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-de5be187-d60e-4000-a419-0598246bc1a7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1296 microversion: 2.1 time: 0.190786 Aug 31 05:18:57.720409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 37/63] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:57 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1296 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:58.033893 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:58.034566 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:58.044053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.044604 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.045916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.049816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.050692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.053223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.137693 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:58.148532 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:58.159679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:58.163522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-27953912-5900-41f0-8d7f-14ea942585ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1284 microversion: 2.20 time: 0.134792 Aug 31 05:18:58.168470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-577e471c-d334-409e-8b2d-49c2c0b7082c req-80eaba9e-2351-4334-ba2a-95c069cc84b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792990df-2cdb-403a-91cc-1a72056ff001", "tag": "f93ce3cf-db3b-4963-b0be-3e5b6226ff58"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:18:58.178308 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 38/64] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:18:58 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:18:58.190439 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-577e471c-d334-409e-8b2d-49c2c0b7082c req-80eaba9e-2351-4334-ba2a-95c069cc84b4 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.191086 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-577e471c-d334-409e-8b2d-49c2c0b7082c req-80eaba9e-2351-4334-ba2a-95c069cc84b4 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.191602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-577e471c-d334-409e-8b2d-49c2c0b7082c req-80eaba9e-2351-4334-ba2a-95c069cc84b4 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.223794 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-577e471c-d334-409e-8b2d-49c2c0b7082c req-80eaba9e-2351-4334-ba2a-95c069cc84b4 service nova] Creating event network-changed:f93ce3cf-db3b-4963-b0be-3e5b6226ff58 for instance 792990df-2cdb-403a-91cc-1a72056ff001 on hv-cinder-85220 Aug 31 05:18:58.225529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-577e471c-d334-409e-8b2d-49c2c0b7082c req-80eaba9e-2351-4334-ba2a-95c069cc84b4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 05:18:58.228163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-577e471c-d334-409e-8b2d-49c2c0b7082c req-80eaba9e-2351-4334-ba2a-95c069cc84b4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 05:18:58.231328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.236435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.237302 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.238095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.238530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.238960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.254289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.compute.rpcapi [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 05:18:58.255311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] Releasing lock "compute-rpcapi-router" {{(pid=120608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 05:18:58.286181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6255ce79-bd84-4f01-ab14-2dcef05a0802 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267583 Aug 31 05:18:58.286792 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 27/65] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:18:58.606199 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:58.606809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:58.616727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.617388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.618196 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.618909 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.619361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.619782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.728738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:58.729427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:58.740619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.741163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.741717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.742435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:58.744675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:58.745130 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:58.789404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:58.798807 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4e8346fe-18fe-43d2-af44-4687ae29ae16 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.195546 Aug 31 05:18:58.800048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 39/66] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:58 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:58.928051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:58.942654 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7491d19a-3814-4eab-a22f-5ff9d91e5fa4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.218532 Aug 31 05:18:58.943260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 28/67] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:58 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:18:59.192376 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:59.193673 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:59.200667 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:59.201156 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:59.201590 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:59.202329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:59.202768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:59.203245 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:59.279861 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:59.293429 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:59.295473 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:59.296898 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-53689e81-a791-4f2e-88ef-8108e93cac89 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1284 microversion: 2.20 time: 0.108693 Aug 31 05:18:59.297609 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 40/68] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:18:59 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:18:59.819871 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:59.820727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:59.827884 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:59.828751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:59.830020 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:59.830987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:59.831769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:59.832401 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:59.969094 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:18:59.969713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:18:59.976582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:59.977160 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:59.977746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:59.978483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:18:59.978926 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:18:59.979489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:18:59.985247 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:18:59.994458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-05ef191e-dbf0-48ad-94da-4e7ab0f23b8c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.178565 Aug 31 05:18:59.995150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 29/69] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:59 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:00.115277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:00.123116 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d0720e5c-4c64-4ac4-a9eb-bcd2edc71394 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.159694 Aug 31 05:19:00.123723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 41/70] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:18:59 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:00.320441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:00.320961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:00.329391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:00.334122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:00.334122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:00.334122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:00.334122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:00.334782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:00.404592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:00.414483 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:00.416902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:00.418032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c2281440-7928-4f19-9730-a766edc3de5c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1284 microversion: 2.20 time: 0.101691 Aug 31 05:19:00.418592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 30/71] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:00 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:01.016003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:01.016670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:01.027016 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:01.028076 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:01.029819 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:01.031834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:01.035788 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:01.036471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:01.147579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:01.149555 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:01.170622 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:01.171435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:01.187489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:01.191432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:01.192619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:01.194212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:01.291421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:01.300342 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-86349b5a-4892-4bf8-b411-d66228f50185 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.288371 Aug 31 05:19:01.312739 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 42/72] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:01 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:01.441273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:01.442193 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:01.453862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:01.454729 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:01.456969 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:01.458059 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:01.460664 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:01.461369 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:01.485823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:01.508045 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-05ff0d53-c721-435e-8275-2772c516291e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.365779 Aug 31 05:19:01.508950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 31/73] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:01 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:01.620219 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:01.634259 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:01.635960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:01.638418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-86a1d411-0c6f-4284-bfb3-0802b4b7b7b0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1284 microversion: 2.20 time: 0.201473 Aug 31 05:19:01.650921 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 43/74] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:01 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:02.344019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:02.347051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:02.349452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=18 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:02.355023 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:02.355539 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:02.355960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:02.356822 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:02.357261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:02.357843 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:02.530150 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:02.531742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:02.542730 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:02.543303 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:02.543803 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:02.544591 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:02.545161 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:02.545796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:02.560913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:02.570646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-038032c1-54a1-4878-b844-cb49b804dc99 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.236674 Aug 31 05:19:02.571245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 32/75] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:02 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:02.669151 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:02.670135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:02.676958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:02.677778 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:02.678249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:02.679201 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:02.679922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:02.680604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:02.720605 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:02.733989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-424d3d7e-a201-4b7b-b3e9-a7875af20f47 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.208492 Aug 31 05:19:02.742050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 44/76] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:02 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:02.764226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:02.773414 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:02.774877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:02.775984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-684e4303-ffc1-4d03-a636-e73c9836f7ae tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1284 microversion: 2.20 time: 0.110912 Aug 31 05:19:02.779666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 33/77] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:02 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:03.593717 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:03.594632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:03.605754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:03.605754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:03.605754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:03.606571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:03.607028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:03.607442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:03.762865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:03.764496 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:03.779139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:03.782581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:03.783360 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:03.784268 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:03.785477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:03.786343 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:03.787024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:03.823417 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:03.840031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a3f49ae5-f317-4f61-87aa-95d9d2431b3c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.250243 Aug 31 05:19:03.848203 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 45/78] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:03 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:03.853805 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:03.854437 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:03.879757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:03.880706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:03.881414 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:03.882831 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:03.883804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:03.884358 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:04.001267 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:04.050749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:04.056495 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:04.057659 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d8a2138c-bfe6-4dd9-bfc7-ceef490c10b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1284 microversion: 2.20 time: 0.207994 Aug 31 05:19:04.064668 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 46/79] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:03 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:04.171082 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:04.183926 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-862a0df2-c4b2-4301-a520-06d2d78b5c95 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.425483 Aug 31 05:19:04.199087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 34/80] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:03 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:04.872424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:04.873124 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:04.875697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:04.881220 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:04.881945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:04.882568 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:04.883600 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:04.884190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:04.884744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:05.049609 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:05.062332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e461475a-92ba-4a53-9f4c-83331a2a836e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.194610 Aug 31 05:19:05.063759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 47/81] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:04 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:05.102419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:05.103694 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:05.122393 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:05.123499 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:05.126753 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:05.127666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:05.128277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:05.128834 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:05.141660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:05.206700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:05.207501 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:05.220427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:05.221237 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:05.221900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:05.222775 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:05.223364 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:05.223920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:05.306047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:05.318556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:05.326080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:05.328829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-00ddfa15-f55b-4eb5-bc92-49bd160bff97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1284 microversion: 2.20 time: 0.231498 Aug 31 05:19:05.331996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 35/82] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:05 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:05.507145 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=18 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:05.715893 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:05.727118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2346673d-0993-41f3-884a-abcd99fa3291 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.526181 Aug 31 05:19:05.727774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 48/83] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:05 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:06.085026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:06.085941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:06.096938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:06.097468 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:06.097997 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:06.099838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:06.100512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:06.101091 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:06.357629 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:06.358359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:06.367726 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:06.369310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:06.370117 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:06.371089 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:06.372077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:06.372654 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:06.561181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:06.575729 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:06.580919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:06.589824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-20b3eac7-fb2b-4ab6-ab6d-fa18572f6e11 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.229778 Aug 31 05:19:06.590542 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 49/84] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:06 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:06.748823 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:06.749949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:06.756389 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:06.757171 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:06.757786 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:06.758710 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:06.759444 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:06.760057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:07.125437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:07.142698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9398c391-a33f-44c7-8c42-8f7a4e3570bc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 1.062046 Aug 31 05:19:07.143285 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 36/85] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:06 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:07.326989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:07.339859 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d99417a3-a3fe-4174-96f6-0465c0e00ef7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.594263 Aug 31 05:19:07.342055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 50/86] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:06 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:07.617223 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:07.617941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:07.633994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:07.636963 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:07.637781 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:07.638667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:07.639125 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:07.641732 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:07.784931 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:07.793911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:07.795652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:07.797169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-04b4ab61-d8d3-4890-8706-20091abfda37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.185683 Aug 31 05:19:07.811264 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 37/87] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:07 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:08.165931 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:08.167243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:08.173898 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:08.174411 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:08.174834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:08.175531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:08.175953 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:08.177933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:08.247768 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:08.336533 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:08.345658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-38fc8327-4051-460b-a359-d8babeffa24e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.185877 Aug 31 05:19:08.347572 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-8c254456-a163-4025-a3cd-c0d82e532127 req-f9d8da99-984e-4787-bcf8-2bee5c0cc577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3104f831-5ba5-4ca1-a955-789bae89cb67", "tag": "d4f7e7d3-760a-499d-bf03-a692cff2b439"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:19:08.358395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 51/88] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:08 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:08.365900 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8c254456-a163-4025-a3cd-c0d82e532127 req-f9d8da99-984e-4787-bcf8-2bee5c0cc577 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:08.366649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8c254456-a163-4025-a3cd-c0d82e532127 req-f9d8da99-984e-4787-bcf8-2bee5c0cc577 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:08.366774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:08.367366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:08.367671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8c254456-a163-4025-a3cd-c0d82e532127 req-f9d8da99-984e-4787-bcf8-2bee5c0cc577 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:08.375784 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:08.376440 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:08.377035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:08.377855 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:08.378463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:08.379009 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:08.386490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-8c254456-a163-4025-a3cd-c0d82e532127 req-f9d8da99-984e-4787-bcf8-2bee5c0cc577 service nova] Creating event network-changed:d4f7e7d3-760a-499d-bf03-a692cff2b439 for instance 3104f831-5ba5-4ca1-a955-789bae89cb67 on hv-cinder-85220 Aug 31 05:19:08.396033 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-8c254456-a163-4025-a3cd-c0d82e532127 req-f9d8da99-984e-4787-bcf8-2bee5c0cc577 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215189 Aug 31 05:19:08.397567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 38/89] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:19:08.405241 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:08.544167 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:08.552129 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cc9e3537-7691-4440-862d-8a47ea17f32e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.189123 Aug 31 05:19:08.552689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 52/90] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:08 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:08.822271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:08.823306 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:08.856139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:08.856668 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:08.857108 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:08.859375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:08.859848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:08.860289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:08.964632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:08.978189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:08.980445 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:08.982507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8a1644e5-7912-4b24-9ec5-d5bfb1c9413b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.165311 Aug 31 05:19:08.983170 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 39/91] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:08 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:09.286724 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e8a68963-52d5-453a-8fd5-ef0da90f5828 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Action: 'create', calling method: .version_select at 0x7fbd0b6b5e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1827070640", "metadata": {"Type": "work"}}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e8a68963-52d5-453a-8fd5-ef0da90f5828 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Request method failure captured: Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 122 Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu9M68FmzU73OvfFUewPuyoxnYSfAER-c5K9IZrgGBw42ST4ic14SU9lkjnDofgYuonYO5WcHHSqXmb7NmpKIgJ879YpKi9R2W8HBPUsXb0_Am8iwVV8C8S7Rzq9Ie3z6nhztNcQIF3owBhuET0fmQ5_5BHsYQBH-3iQlQmrtde8UvM Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:19:09.292765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d8cc9a55beb49098a0a489fd69450f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 8852f6fab4ba467d94cdec7f358b192f Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1827070640", "metadata": {"Type": "work"}}} Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: Aug 31 05:19:09.294280 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1827070640', 'metadata': {'Type': 'work'}}}} Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise error Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:19:09.295115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 05:19:09.296484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 05:19:09.297630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 05:19:09.297630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.297630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e8a68963-52d5-453a-8fd5-ef0da90f5828 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:19:09.297630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e8a68963-52d5-453a-8fd5-ef0da90f5828 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.259175 Aug 31 05:19:09.297630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 53/92] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Aug 31 05:19:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:19:09.307706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1d0dbf53-917e-4fd7-a26c-70ac5e153733 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Action: 'create', calling method: .version_select at 0x7fbd0b6c6040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1123582286", "metadata": {"Type": "work"}}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1d0dbf53-917e-4fd7-a26c-70ac5e153733 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Request method failure captured: Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 120 Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu9M68FmzU73OvfFUewPuyoxnYSfAER-c5K9IZrgGBw42ST4ic14SU9lkjnDofgYuonYO5WcHHSqXmb7NmpKIgJ879YpKi9R2W8HBPUsXb0_Am8iwVV8C8S7Rzq9Ie3z6nhztNcQIF3owBhuET0fmQ5_5BHsYQBH-3iQlQmrtde8UvM Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:19:09.313447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d8cc9a55beb49098a0a489fd69450f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 8852f6fab4ba467d94cdec7f358b192f Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1123582286", "metadata": {"Type": "work"}}} Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: Aug 31 05:19:09.314878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1123582286', 'metadata': {'Type': 'work'}}}} Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise error Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi '0' Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:19:09.315938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 05:19:09.317262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 05:19:09.319304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 05:19:09.319304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.319304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1d0dbf53-917e-4fd7-a26c-70ac5e153733 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:19:09.319304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1d0dbf53-917e-4fd7-a26c-70ac5e153733 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013369 Aug 31 05:19:09.319304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 40/93] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Aug 31 05:19:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 05:19:09.327144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b61af051-7e70-40fd-984d-07a247be3f7d tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Action: 'create', calling method: .version_select at 0x7fbd0b6cbd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1404286788", "metadata": {"Type": "work"}}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b61af051-7e70-40fd-984d-07a247be3f7d tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Request method failure captured: Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 119 Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu9M68FmzU73OvfFUewPuyoxnYSfAER-c5K9IZrgGBw42ST4ic14SU9lkjnDofgYuonYO5WcHHSqXmb7NmpKIgJ879YpKi9R2W8HBPUsXb0_Am8iwVV8C8S7Rzq9Ie3z6nhztNcQIF3owBhuET0fmQ5_5BHsYQBH-3iQlQmrtde8UvM Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:19:09.330735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d8cc9a55beb49098a0a489fd69450f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 8852f6fab4ba467d94cdec7f358b192f Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1404286788", "metadata": {"Type": "work"}}} Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: Aug 31 05:19:09.332231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1404286788', 'metadata': {'Type': 'work'}}}} Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise error Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi '' Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:19:09.333405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 05:19:09.334941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 05:19:09.335949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 05:19:09.335949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.335949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b61af051-7e70-40fd-984d-07a247be3f7d tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:19:09.335949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b61af051-7e70-40fd-984d-07a247be3f7d tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009137 Aug 31 05:19:09.335949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 54/94] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Aug 31 05:19:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:19:09.341954 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-97ea9b13-badd-46c9-98d4-de019ee4a9a5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Calling method '.version_select at 0x7fbd0b76caf0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:09.368122 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:09.368790 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:09.373158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-97ea9b13-badd-46c9-98d4-de019ee4a9a5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] HTTP exception thrown: Volume tempest-invalid-921420643 could not be found. Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-97ea9b13-badd-46c9-98d4-de019ee4a9a5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Request method failure captured: Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-921420643 HTTP/1.1 Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu9M68FmzU73OvfFUewPuyoxnYSfAER-c5K9IZrgGBw42ST4ic14SU9lkjnDofgYuonYO5WcHHSqXmb7NmpKIgJ879YpKi9R2W8HBPUsXb0_Am8iwVV8C8S7Rzq9Ie3z6nhztNcQIF3owBhuET0fmQ5_5BHsYQBH-3iQlQmrtde8UvM Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:19:09.375988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d8cc9a55beb49098a0a489fd69450f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 8852f6fab4ba467d94cdec7f358b192f Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Volume tempest-invalid-921420643 could not be found. Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'tempest-invalid-921420643'} Aug 31 05:19:09.377254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-921420643 could not be found. (HTTP 404) (Request-ID: req-2e9e5339-e0df-40bc-9586-62bb65233d7f) Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.377982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 05:19:09.379144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-921420643 could not be found. Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:19:09.380168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-921420643 could not be found. Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-921420643 could not be found. Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-97ea9b13-badd-46c9-98d4-de019ee4a9a5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Returning 404 to user: Volume tempest-invalid-921420643 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-97ea9b13-badd-46c9-98d4-de019ee4a9a5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-921420643" status: 404 len: 98 microversion: 2.1 time: 0.039509 Aug 31 05:19:09.381232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 41/95] 10.222.0.36 () {58 vars in 1215 bytes} [Wed Aug 31 05:19:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-921420643 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 05:19:09.388711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5221fc6e-7c46-4791-aeec-31d4937ba1dd tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004355 Aug 31 05:19:09.389373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 42/96] 10.222.0.36 () {58 vars in 1140 bytes} [Wed Aug 31 05:19:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 05:19:09.399761 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-233a38bf-9b68-4bdd-9788-347d43df6da4 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003799 Aug 31 05:19:09.400517 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 43/97] 10.222.0.36 () {58 vars in 1137 bytes} [Wed Aug 31 05:19:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 05:19:09.411862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:09.412356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:09.412806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:09.413486 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:09.413932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:09.414426 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6aa10f17-f308-4cce-b319-78262e1ec7e5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Calling method '.version_select at 0x7fbd0b6c6550>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:09.414579 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:09.452352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-6aa10f17-f308-4cce-b319-78262e1ec7e5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] HTTP exception thrown: Volume 6751926f-87c2-472a-b585-a2e1c445bad2 could not be found. Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6aa10f17-f308-4cce-b319-78262e1ec7e5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Request method failure captured: Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/os-volumes/6751926f-87c2-472a-b585-a2e1c445bad2 HTTP/1.1 Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu9M68FmzU73OvfFUewPuyoxnYSfAER-c5K9IZrgGBw42ST4ic14SU9lkjnDofgYuonYO5WcHHSqXmb7NmpKIgJ879YpKi9R2W8HBPUsXb0_Am8iwVV8C8S7Rzq9Ie3z6nhztNcQIF3owBhuET0fmQ5_5BHsYQBH-3iQlQmrtde8UvM Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:19:09.455070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d8cc9a55beb49098a0a489fd69450f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 8852f6fab4ba467d94cdec7f358b192f Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Volume 6751926f-87c2-472a-b585-a2e1c445bad2 could not be found. Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '6751926f-87c2-472a-b585-a2e1c445bad2'} Aug 31 05:19:09.456567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6751926f-87c2-472a-b585-a2e1c445bad2 could not be found. (HTTP 404) (Request-ID: req-995c86ab-338d-457d-9853-c1aeb22633a0) Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.457452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 05:19:09.458721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6751926f-87c2-472a-b585-a2e1c445bad2 could not be found. Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 05:19:09.459944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6751926f-87c2-472a-b585-a2e1c445bad2 could not be found. Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6751926f-87c2-472a-b585-a2e1c445bad2 could not be found. Aug 31 05:19:09.461104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.462787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6aa10f17-f308-4cce-b319-78262e1ec7e5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Returning 404 to user: Volume 6751926f-87c2-472a-b585-a2e1c445bad2 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:19:09.463789 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6aa10f17-f308-4cce-b319-78262e1ec7e5 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/6751926f-87c2-472a-b585-a2e1c445bad2" status: 404 len: 109 microversion: 2.1 time: 0.053305 Aug 31 05:19:09.464337 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 44/98] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:19:09 2022] DELETE /compute/v2.1/os-volumes/6751926f-87c2-472a-b585-a2e1c445bad2 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:19:09.478359 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-23df4e68-1cb5-46d3-ab8e-accaccd7c186 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Calling method '.version_select at 0x7fbd0b6c6e50>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:09.512888 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-23df4e68-1cb5-46d3-ab8e-accaccd7c186 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] HTTP exception thrown: Volume 6b844798-4a89-4b2d-86a3-1ab95cd1eb66 could not be found. Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-23df4e68-1cb5-46d3-ab8e-accaccd7c186 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Request method failure captured: Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/os-volumes/6b844798-4a89-4b2d-86a3-1ab95cd1eb66 HTTP/1.1 Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu9M68FmzU73OvfFUewPuyoxnYSfAER-c5K9IZrgGBw42ST4ic14SU9lkjnDofgYuonYO5WcHHSqXmb7NmpKIgJ879YpKi9R2W8HBPUsXb0_Am8iwVV8C8S7Rzq9Ie3z6nhztNcQIF3owBhuET0fmQ5_5BHsYQBH-3iQlQmrtde8UvM Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:19:09.515448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0d8cc9a55beb49098a0a489fd69450f1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0d8cc9a55beb49098a0a489fd69450f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 0d8cc9a55beb49098a0a489fd69450f1 Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesNegativeTest-604378347 Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 8852f6fab4ba467d94cdec7f358b192f Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesNegativeTest-604378347-project Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Volume 6b844798-4a89-4b2d-86a3-1ab95cd1eb66 could not be found. Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '6b844798-4a89-4b2d-86a3-1ab95cd1eb66'} Aug 31 05:19:09.516942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b844798-4a89-4b2d-86a3-1ab95cd1eb66 could not be found. (HTTP 404) (Request-ID: req-3fb58c32-8edf-421e-a3f2-0ae8b18ed67d) Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.517729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 05:19:09.519053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b844798-4a89-4b2d-86a3-1ab95cd1eb66 could not be found. Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 05:19:09.520313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b844798-4a89-4b2d-86a3-1ab95cd1eb66 could not be found. Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b844798-4a89-4b2d-86a3-1ab95cd1eb66 could not be found. Aug 31 05:19:09.522096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:19:09.525076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-23df4e68-1cb5-46d3-ab8e-accaccd7c186 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] Returning 404 to user: Volume 6b844798-4a89-4b2d-86a3-1ab95cd1eb66 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:19:09.526211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-23df4e68-1cb5-46d3-ab8e-accaccd7c186 tempest-VolumesNegativeTest-604378347 tempest-VolumesNegativeTest-604378347-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6b844798-4a89-4b2d-86a3-1ab95cd1eb66" status: 404 len: 109 microversion: 2.1 time: 0.052626 Aug 31 05:19:09.526959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 45/99] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 05:19:09 2022] GET /compute/v2.1/os-volumes/6b844798-4a89-4b2d-86a3-1ab95cd1eb66 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:19:09.572845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:09.573710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:09.584448 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:09.586816 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:09.587498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:09.588115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:09.588986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:09.589821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:09.590598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:09.594428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4f82ed2d-ec8b-4e62-a22b-a0ffb752d63c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.230359 Aug 31 05:19:09.595428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 55/100] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:09 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:09.750844 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:09.778801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-193e902d-b355-4c1d-a020-1a3acdd06c6b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.209471 Aug 31 05:19:09.779395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 46/101] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:09 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:10.007875 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:10.008556 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:10.015097 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:10.015576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:10.016165 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:10.016847 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:10.017430 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:10.017833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:10.104073 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:10.114506 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:10.116781 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:10.118426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bc9a9324-afb9-4f2b-8482-099c0237b53a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.114676 Aug 31 05:19:10.119510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 56/102] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:10 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:10.617356 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:10.618409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:10.625362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:10.625837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:10.626318 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:10.626996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:10.627793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:10.627880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:10.791935 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:10.799656 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:10.800376 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-34591365-a09d-40d2-b00c-04d8a9bc0d6b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.188478 Aug 31 05:19:10.800991 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:10.801634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 47/103] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:10 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:10.812207 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:10.812691 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:10.814567 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:10.815277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:10.815729 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:10.816149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:10.974367 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:10.983027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d5b1f777-7155-4251-aac2-e897ae3a409e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.187544 Aug 31 05:19:10.995946 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 57/104] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:10 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:11.143325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:11.143987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:11.151415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:11.152142 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:11.153254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:11.154180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:11.154631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:11.155020 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:11.223970 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:11.239884 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:11.241505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:11.242808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cf5cfe09-6f68-4830-b863-ec0764563848 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.103729 Aug 31 05:19:11.243759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 48/105] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:11 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:11.821120 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:11.822518 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:11.824571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:11.829534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:11.830098 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:11.830545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:11.831426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:11.832076 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:11.832632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:11.988896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:11.997894 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2725bf76-e820-4fdf-9a0e-630fe6eda472 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.180213 Aug 31 05:19:11.998509 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 58/106] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:11 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:12.004727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:12.006570 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:12.014247 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:12.014971 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:12.015703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:12.016922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:12.017499 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:12.018191 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:12.173156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:12.183038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b999f8dd-ac54-41ce-b0e3-af1bf3995468 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.182214 Aug 31 05:19:12.190727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 49/107] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:11 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:12.265661 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:12.266256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:12.274147 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:12.274979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:12.275278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:12.276115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:12.276683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:12.277195 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:12.351834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:12.360705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:12.363032 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:12.364241 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e54e4e46-551c-40d5-944d-01be823a0da3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.103455 Aug 31 05:19:12.365205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 59/108] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:12 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:13.018669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:13.019316 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:13.025776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:13.026674 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:13.027152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:13.027865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:13.028689 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:13.029179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:13.162929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:13.171469 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a3da4314-8483-406c-bce9-a2cd8e301ece tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.156538 Aug 31 05:19:13.172041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 50/109] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:13 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:13.204327 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:13.205007 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:13.211485 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:13.211954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:13.212405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:13.213073 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:13.213507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:13.213887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:13.352166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:13.364600 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d3fe8cbd-0f0d-4392-b4df-6bafa62d202f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.164046 Aug 31 05:19:13.365107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 60/110] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:13 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:13.391256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:13.391939 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:13.397837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:13.398526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:13.399018 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:13.399757 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:13.400207 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:13.400621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:13.461165 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:13.469309 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:13.470902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:13.472158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-493d34c7-de89-40b5-902e-bdc025766119 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.085045 Aug 31 05:19:13.472582 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 51/111] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:13 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:14.192563 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:14.193056 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:14.199712 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:14.200178 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:14.200582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:14.201251 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:14.201690 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:14.202122 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:14.338396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:14.346705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-796a5576-0d18-4b5e-95c2-a6da705b2ec8 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.158042 Aug 31 05:19:14.347301 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 61/112] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:14 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:14.386215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:14.386786 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:14.392951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:14.393425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:14.393841 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:14.394535 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:14.395036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:14.395379 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:14.495555 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:14.496266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:14.503510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:14.504064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:14.504574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:14.505687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:14.506173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:14.506584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:14.536473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:14.551824 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-94cffecb-eeb4-45fd-a3ce-8bbe07b7fa9e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.169383 Aug 31 05:19:14.552398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 52/113] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:14 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:14.574911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:14.583298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:14.584721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:14.585820 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-00997969-8bca-420f-8361-e7ccc28d8096 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.094175 Aug 31 05:19:14.586403 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 62/114] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:14 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:15.371261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:15.372120 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:15.382383 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:15.383300 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:15.384043 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:15.385141 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:15.385876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:15.387797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:15.521666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:15.530600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2461cde9-91d7-4cd1-9031-ca9da0bce5c0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.165778 Aug 31 05:19:15.531188 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 53/115] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:15 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:15.572274 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:15.572899 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:15.579038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:15.579510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:15.579934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:15.580610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:15.581051 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:15.581462 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:15.612362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:15.612362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:15.615992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:15.616464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:15.616889 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:15.617561 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:15.618013 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:15.618444 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:15.694415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:15.702929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:15.704338 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:15.705438 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-433a4851-933e-405f-8ca0-0dc9e49c4bbb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.100987 Aug 31 05:19:15.706136 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 54/116] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:15 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:15.736576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:15.744596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5b06db3b-b8eb-416b-8289-369f60821430 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.176129 Aug 31 05:19:15.745151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 63/117] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:15 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:16.555671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:16.556707 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:16.569804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:16.569804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:16.569804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:16.570448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:16.570888 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:16.571871 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:16.728795 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:16.729407 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:16.735667 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:16.736452 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:16.736939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:16.737791 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:16.738413 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:16.738826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:16.750794 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:16.761677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4f6ef714-a2bd-4532-b389-be276f0aa9d0 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.212307 Aug 31 05:19:16.777796 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 55/118] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:16 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:16.787004 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:16.787664 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:16.794743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:16.795569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:16.796230 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:16.797451 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:16.798078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:16.798491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:16.830579 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:16.839361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:16.840883 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:16.842093 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-89943b4e-8878-4924-85e5-ee4c5ec55e74 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1276 microversion: 2.20 time: 0.118132 Aug 31 05:19:16.844348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 64/119] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:16 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1276 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:17.108297 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:17.116769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9a22ab74-d06b-49f8-a00b-b3ab41745765 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.337299 Aug 31 05:19:17.117346 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 56/120] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:16 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:17.785127 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:17.785790 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:17.794471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:17.794948 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:17.795365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:17.796118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:17.804680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:17.805122 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:17.866800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:17.867581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:17.880187 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:17.880187 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:17.880622 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:17.881374 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:17.881990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:17.884394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:18.057630 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:18.068764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:18.071030 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:18.073146 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-acb97d56-899b-4068-94a4-b8d103ce93ab tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1338 microversion: 2.20 time: 0.211487 Aug 31 05:19:18.086491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 57/121] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:17 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1338 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:18.138110 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:18.138768 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:18.148673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:18.151291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:18.151962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:18.154149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:18.154954 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:18.155886 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:18.198328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:18.218113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:18.231568 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b589a7c3-2fd1-43af-94cc-4f2eae29520f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.450615 Aug 31 05:19:18.244198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 65/122] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:17 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:18.532083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:18.541824 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9f7420fa-85be-48d2-ac0d-2ced5f16b5fd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.408058 Aug 31 05:19:18.552411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 58/123] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:18 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:19.100717 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:19.102045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:19.109515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:19.109996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:19.110492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:19.118244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:19.119161 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:19.120159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:19.261529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:19.262319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:19.270880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:19.271665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:19.272292 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:19.273134 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:19.273859 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:19.274338 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:19.285269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:19.293579 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:19.295050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:19.296267 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-969e8dad-3f2b-438f-aacd-42ebd526c030 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.203433 Aug 31 05:19:19.296821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 66/124] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:19 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:19.423642 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:19.447505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eb6eb8dd-c05b-461a-ab6c-3b06da595b92 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.190428 Aug 31 05:19:19.448534 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 59/125] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:19 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:19.565401 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:19.566029 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:19.572388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:19.572875 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:19.573304 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:19.573987 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:19.574479 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:19.574884 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:19.732685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:19.742923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b67391c4-6e96-433b-9451-329f86d9b828 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.182586 Aug 31 05:19:19.743517 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 67/126] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:19 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:20.322754 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:20.323766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:20.334256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:20.335041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:20.335742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:20.336865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:20.337605 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:20.338342 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:20.468696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:20.469296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:20.475187 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:20.475482 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:20.475960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:20.476385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:20.477096 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:20.477538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:20.477949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:20.483426 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:20.484876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:20.486324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a6e65b3e-a14c-4c1d-afe3-bd6eb9cd5a44 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.169880 Aug 31 05:19:20.486920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 60/127] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:20 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:20.605096 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:20.613702 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-77cbbbaa-b724-4748-bb15-8096d1268dd5 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.148973 Aug 31 05:19:20.614320 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 68/128] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:20 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:20.763304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:20.763893 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:20.772987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:20.773616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:20.774312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:20.775431 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:20.775991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:20.776409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:20.916320 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:20.924021 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-560ea4ad-2e9c-4ea3-82d9-e05767be03ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.164630 Aug 31 05:19:20.924585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 61/129] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:20 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:21.508583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:21.509174 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:21.515595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:21.516104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:21.516527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:21.517201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:21.517643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:21.518047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:21.634861 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:21.635407 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:21.641708 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:21.642263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:21.642686 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:21.643344 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:21.643815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:21.644227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:21.649618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:21.658276 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:21.659706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:21.660821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c1cb8783-4edd-4c0d-912d-6eedf42757da tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.156157 Aug 31 05:19:21.661408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 69/130] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:21 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:21.775169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:21.786817 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-31f3ab0d-2e91-40cd-af8b-209776f673dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.156072 Aug 31 05:19:21.787739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 62/131] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:21 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:21.944848 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:21.945478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:21.952466 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:21.952943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:21.953347 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:21.954405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:21.954853 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:21.955459 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:22.098440 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:22.103456 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:22.110063 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9ac8fb88-4f9b-4493-9f25-d79b313f20de tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.169237 Aug 31 05:19:22.110635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 70/132] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:21 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:22.683465 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:22.684018 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:22.690562 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:22.691032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:22.691447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:22.692113 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:22.692546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:22.692950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:22.807135 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:22.807733 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:22.814210 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:22.814625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:22.815051 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:22.815762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:22.816206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:22.816621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:22.830958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:22.839908 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:22.841312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:22.842483 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-baa4ffb5-79f4-49da-a769-82174fd1c8e6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.162958 Aug 31 05:19:22.843059 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 63/133] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:22 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:22.957234 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:22.965905 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fa345e75-4991-458d-9b57-b5c7510bc6cc tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.162891 Aug 31 05:19:22.966733 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 71/134] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:22 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:23.135892 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:23.136751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:23.144671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:23.145145 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:23.145564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:23.146284 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:23.146722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:23.147128 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:23.291307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:23.299119 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3402a3b5-876f-4f26-9b62-0f56110b7270 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.169673 Aug 31 05:19:23.299693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 64/135] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:23 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:23.869152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:23.870152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:23.880804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:23.881671 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:23.882452 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:23.883547 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:23.884284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:23.884958 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:23.987100 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:23.987716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:23.994195 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:23.994669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:23.995073 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:23.995738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:23.996165 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:23.996569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:24.016634 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:24.030887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:24.032670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:24.034046 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-41669f7d-51ab-4903-9ec6-8057b7eb9363 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.171290 Aug 31 05:19:24.034633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 72/136] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:23 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:24.137338 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:24.145172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ce4c5c37-015a-4c57-ab1d-7e3785f4b3ca tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.162282 Aug 31 05:19:24.145744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 65/137] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:23 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:24.322610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:24.323201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:24.329430 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:24.329899 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:24.330358 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:24.331048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:24.331484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:24.331890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:24.462545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:24.470524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a5af9538-b6bc-4890-8054-9e3d22249fab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.154181 Aug 31 05:19:24.471077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 73/138] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:24 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:25.057034 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:25.057616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:25.064194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:25.064671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:25.065094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:25.065767 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:25.066252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:25.066665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:25.165924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:25.166494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:25.172577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:25.173053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:25.173477 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:25.174181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:25.174640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:25.175057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:25.200443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:25.210064 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:25.212172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:25.213821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-05c9ace2-fe1e-4f7f-b372-4e48363d5c3b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.160451 Aug 31 05:19:25.214547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 66/139] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:25 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:25.312422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:25.320196 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f8b1439a-e024-4a6c-967a-1f7d507117c7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.158138 Aug 31 05:19:25.320741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 74/140] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:25 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:25.495808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:25.496881 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:25.504191 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:25.504666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:25.505089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:25.505767 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:25.506246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:25.506660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:25.631679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:25.639746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c23de5fe-ad19-4b4b-bd5c-be4877dff2da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.150466 Aug 31 05:19:25.640321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 67/141] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:25 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:26.242677 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:26.243688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:26.250059 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:26.250540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:26.250965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:26.251647 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:26.252160 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:26.252519 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:26.342173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:26.343073 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:26.350633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:26.351099 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:26.351512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:26.352181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:26.352615 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:26.353017 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:26.387105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:26.395640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:26.397118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:26.398257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0f33c150-be96-4670-bd5c-330b3bd387f7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.159631 Aug 31 05:19:26.398822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 75/142] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:26 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:26.481056 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:26.493436 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-44fd10b8-fa52-456d-ad3e-065c70b77c4e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.155619 Aug 31 05:19:26.494336 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 68/143] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:26 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:26.665823 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:26.666442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:26.672590 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:26.673060 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:26.673476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:26.674197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:26.674632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:26.675037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:26.812481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:26.820487 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0c04bb0d-45a3-47fd-aab7-8d41302dd973 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.158465 Aug 31 05:19:26.821057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 76/144] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:26 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:27.424820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:27.425782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:27.435831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:27.436613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:27.437312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:27.438576 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:27.439213 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:27.439895 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:27.516213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:27.516788 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:27.522782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:27.523254 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:27.523679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:27.524375 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:27.524811 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:27.525217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:27.604797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:27.613446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:27.614895 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:27.616016 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-effeb9e1-0963-4715-8606-f1da13b7ee4b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.197859 Aug 31 05:19:27.616569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 69/145] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:27 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:27.673854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:27.681856 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8239a401-77f0-44ab-a018-8f128e74d7df tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.169670 Aug 31 05:19:27.682469 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 77/146] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:27 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:27.841612 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:27.842241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:27.848776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:27.849250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:27.849677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:27.850418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:27.850874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:27.851320 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:27.980125 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:27.992239 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b6ec26d8-b590-4846-bd86-7976ba7991b0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.154243 Aug 31 05:19:27.992986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 70/147] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:27 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:28.642582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:28.643428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:28.653402 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:28.654257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:28.654955 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:28.655805 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:28.656245 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:28.656655 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:28.703230 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:28.703901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:28.710196 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:28.710744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:28.711249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:28.711989 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:28.712463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:28.712872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:28.828853 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:28.837399 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:28.838921 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:28.840010 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-157e9ee1-dc94-48f8-988e-84ac18fa8f90 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.204016 Aug 31 05:19:28.840771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 78/148] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:28 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:28.873391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:28.881146 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7bb905aa-2d19-466e-aedc-0f2d101225dd tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.181966 Aug 31 05:19:28.881803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 71/149] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:28 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:29.016207 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:29.017113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:29.029266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:29.030255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:29.031024 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:29.031881 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:29.032466 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:29.033295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:29.174090 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:29.181895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-68c149ae-0a38-42fd-b5c8-0521acf020fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.170134 Aug 31 05:19:29.182537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 79/150] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:29 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:29.862525 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:29.863116 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:29.869121 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:29.869510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:29.869949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:29.870616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:29.871072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:29.871477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:29.903250 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:29.903791 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:29.910050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:29.910539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:29.910961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:29.911639 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:29.912081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:29.912489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:30.048437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:30.059914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:30.061544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:30.062637 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2014717a-e26d-451a-9da5-b1771d789893 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.204385 Aug 31 05:19:30.063362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 72/151] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:29 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:30.083445 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:30.091625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-03d9d855-1e34-4a51-ac04-1dc27009dc00 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.192145 Aug 31 05:19:30.092577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 80/152] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:29 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:30.202385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:30.202973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:30.209107 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:30.209577 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:30.209994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:30.210677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:30.211112 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:30.211520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:30.341013 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:30.348665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6a8cc3d1-3d66-4974-8a26-2aab67fc87f5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.150065 Aug 31 05:19:30.354782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 73/153] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:30 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:31.085626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:31.086265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:31.092759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:31.093233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:31.093650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:31.094361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:31.094799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:31.095214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:31.114312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:31.115042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:31.121419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:31.121890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:31.122382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:31.123052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:31.123524 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:31.123943 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:31.297297 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:31.305627 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:31.307082 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:31.307223 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:31.308186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6049c98a-2fa3-4f18-b89e-3170dc519579 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.226568 Aug 31 05:19:31.308746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 81/154] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:31 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:31.315516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8ac5de22-5a88-4fed-8ffb-45d14d023695 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.206831 Aug 31 05:19:31.316188 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 74/155] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:31 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:31.376619 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:31.377659 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:31.388039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:31.388835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:31.389640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:31.390358 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:31.390805 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:31.391226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:31.526299 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:31.535606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a932b8a1-357f-4dcf-9119-1fa197898aac tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.165819 Aug 31 05:19:31.536175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 82/156] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:31 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:32.330229 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:32.330965 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:32.336075 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:32.337205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:32.337610 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:32.338075 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:32.338712 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:32.339352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:32.340142 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:32.340544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:32.343708 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:32.344169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:32.344584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:32.344739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:32.345534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:32.346255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:32.346716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:32.533367 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:32.537339 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:32.541879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:32.543350 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:32.544609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d02b16a0-835a-4c51-ac79-ad4ec154a9ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.218309 Aug 31 05:19:32.545319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 75/157] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:32 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:32.545686 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8c4bb445-e326-4350-87a3-8ea0ef184c9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.213384 Aug 31 05:19:32.546367 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 83/158] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:32 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:32.555980 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:32.556509 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:32.562330 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:32.562804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:32.563226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:32.563864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:32.564332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:32.564744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:32.690639 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:32.698697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-956d08d1-ab64-408d-96c7-882ca6eb2e10 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.146275 Aug 31 05:19:32.699266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 76/159] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:32 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:33.566472 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:33.567031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:33.567281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:33.568007 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:33.573436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:33.574182 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:33.574341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:33.574606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:33.574811 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:33.575237 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:33.575383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:33.575705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:33.575888 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:33.576110 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:33.576328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:33.576964 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:33.913759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:33.916978 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:33.921718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7d23650f-1c36-4f5e-a125-0442b2eac960 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.359059 Aug 31 05:19:33.922522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 84/160] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:33 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:33.927207 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:33.928658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:33.929451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:33.930048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:33.931306 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-de62cd75-8e73-43c5-9632-f8d0fc98c834 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.368296 Aug 31 05:19:33.932925 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 77/161] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:33 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:33.936933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:33.937416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:33.937845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:33.938572 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:33.939020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:33.939458 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:34.072596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:34.080392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bb5c079d-3874-46aa-91bd-57d88718fa1d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.156252 Aug 31 05:19:34.081058 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 85/162] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:33 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:34.942906 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:34.943577 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:34.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=76 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:34.953306 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:34.953787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:34.954235 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:34.954672 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:34.955123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:34.955266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:34.955369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:34.955753 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:34.961320 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:34.961789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:34.962296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:34.963009 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:34.963442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:34.963845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:35.149547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:35.156426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:35.161219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f034f27b-ee88-4d22-8882-c496a026ea7f tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.222500 Aug 31 05:19:35.162356 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 78/163] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:34 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:35.175675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:35.175675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:35.175675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-de95c5ce-4c5d-4ba1-ad3b-cd82dbae7808 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.218919 Aug 31 05:19:35.176069 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 86/164] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:34 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:35.176069 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:35.176436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:35.184338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:35.184915 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:35.185338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:35.186145 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:35.186597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:35.187143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:35.210332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:35.379063 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:35.387416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9417f83e-1fe7-4587-929c-016f1004eaa7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.216269 Aug 31 05:19:35.390284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 87/165] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:35 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:35.772347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-903d041b-481f-42ec-bf07-0dda45c78106 req-f973258b-7df5-4938-8b03-84d44b9400b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b209be4-6027-4328-a956-5deea7de1a64", "tag": "918fbec4-f9a6-4f49-98c8-ddb91a52e37a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:19:35.782859 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-903d041b-481f-42ec-bf07-0dda45c78106 req-f973258b-7df5-4938-8b03-84d44b9400b0 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:35.783213 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-903d041b-481f-42ec-bf07-0dda45c78106 req-f973258b-7df5-4938-8b03-84d44b9400b0 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:35.783634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-903d041b-481f-42ec-bf07-0dda45c78106 req-f973258b-7df5-4938-8b03-84d44b9400b0 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:35.795409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-903d041b-481f-42ec-bf07-0dda45c78106 req-f973258b-7df5-4938-8b03-84d44b9400b0 service nova] Creating event network-changed:918fbec4-f9a6-4f49-98c8-ddb91a52e37a for instance 5b209be4-6027-4328-a956-5deea7de1a64 on hv-cinder-85220 Aug 31 05:19:35.801054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-903d041b-481f-42ec-bf07-0dda45c78106 req-f973258b-7df5-4938-8b03-84d44b9400b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032412 Aug 31 05:19:35.802038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 79/166] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:19:36.184690 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:36.185325 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:36.192918 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:36.193514 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:36.194054 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:36.194430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:36.194549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:36.195146 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:36.195588 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:36.196027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:36.201245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:36.201715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:36.202150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:36.202812 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:36.203249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:36.203649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:36.438527 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:36.450455 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:36.452949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:36.466874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bf4bf3b7-6b29-43ee-9607-d259825172aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.278225 Aug 31 05:19:36.467504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 80/167] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:36 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:36.474839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:36.480044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:36.492189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:36.494722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:36.495402 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:36.496754 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:36.497662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:36.500335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:36.501228 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:36.505276 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1d20a331-8138-4dcf-ba92-5538ee85a57d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.322766 Aug 31 05:19:36.506118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 88/168] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:36 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:36.656490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:36.664997 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9f979ba1-7487-45fa-9bd9-7e3ad977e3cb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.193708 Aug 31 05:19:36.670878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 81/169] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:36 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:37.490367 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:37.491507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:37.497746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:37.498263 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:37.498848 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:37.499591 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:37.499977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:37.500381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:37.529528 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:37.530236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:37.537697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:37.538335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:37.538754 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:37.539424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:37.539865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:37.540279 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:37.713395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:37.722873 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:37.724299 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:37.724750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:37.725397 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-552cae7b-d942-4b50-82c2-057f86e231d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.239001 Aug 31 05:19:37.725959 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 89/170] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:37 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:37.730865 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:37.731539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:37.737296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b0671b30-6dc6-4f10-bb3c-137778cda7a7 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.213042 Aug 31 05:19:37.738237 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:37.738777 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:37.739407 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:37.740404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:37.741000 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:37.741416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:37.746569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 82/171] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:37 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:37.871978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:37.880329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e14be09b-4ac5-404c-a476-5d3966ada8a4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.153032 Aug 31 05:19:37.880883 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 90/172] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:37 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:38.748005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:38.749377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:38.758047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:38.758234 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:38.758645 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:38.758734 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:38.759008 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:38.759717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:38.760154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:38.760597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:38.767138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:38.767880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:38.768565 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:38.769580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:38.770407 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:38.771017 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:38.970450 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:38.973181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:38.980709 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:38.981428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9c9a2d79-25fa-4d62-831e-d2103447a5b2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.227048 Aug 31 05:19:38.991230 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 91/173] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:38 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:38.991369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:38.991369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a37dc7fa-0cd3-4433-b251-3a95c777ce71 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.239514 Aug 31 05:19:38.991369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 83/174] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:38 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:38.994761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:38.995357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:39.001276 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:39.001745 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:39.002214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:39.002878 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:39.003311 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:39.003716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:39.145267 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:39.152955 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fdddb18b-9681-4087-bcd3-febff8d67c34 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.169999 Aug 31 05:19:39.153515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 92/175] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:38 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:40.003321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:40.003869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:40.006340 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:40.006939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:40.010169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:40.010644 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:40.011069 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:40.011749 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:40.012176 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:40.012604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:40.013135 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:40.013594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:40.014052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:40.014723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:40.015160 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:40.015568 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:40.208267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:40.211969 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:40.216292 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c19764e8-f605-4c3c-b540-ca3770160beb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.217090 Aug 31 05:19:40.216866 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 84/176] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:39 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:40.220166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:40.221271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:40.221592 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:40.221864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:40.222780 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2feb4c6b-49df-4fd8-8f8a-e46cb3f24ee6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.220250 Aug 31 05:19:40.227658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:40.228129 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:40.228546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:40.229209 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:40.229649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:40.230078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:40.234246 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 93/177] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:40 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:40.361845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:40.369646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a6d94027-2349-425d-95e7-6b62a3c1eedf tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.151780 Aug 31 05:19:40.370244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 85/178] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:40 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:41.237993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:41.238723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:41.245330 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:41.245790 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:41.246324 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:41.246582 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:41.246863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:41.247654 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:41.248400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:41.248858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:41.252677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:41.253298 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:41.253877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:41.254735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:41.255317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:41.255870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:41.444065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:41.450901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:41.452960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-54b55da4-2ec8-4006-ab9e-c6d972d125ef tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.219002 Aug 31 05:19:41.453726 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 94/179] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:41 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:41.463418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:41.463418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:41.463418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-597c0c8e-a269-4e0c-98b3-9e1e64d63d7c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.221628 Aug 31 05:19:41.466802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 86/180] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:41 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:41.467971 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:41.468555 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:41.474651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:41.475122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:41.475717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:41.476454 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:41.476832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:41.477247 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:41.608441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:41.616972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-db18c6ec-c858-45fa-8da3-da4d7f38f226 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.152637 Aug 31 05:19:41.617542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 87/181] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:41 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:42.382457 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-805c2ee0-097b-429a-81cd-8e23682387cd req-f4b1aa02-7f0a-42fa-9a4e-1b3f0f9b634f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3104f831-5ba5-4ca1-a955-789bae89cb67", "name": "network-vif-plugged", "status": "completed", "tag": "d4f7e7d3-760a-499d-bf03-a692cff2b439"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:19:42.387542 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=74 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:42.396113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-805c2ee0-097b-429a-81cd-8e23682387cd req-f4b1aa02-7f0a-42fa-9a4e-1b3f0f9b634f service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.396570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-805c2ee0-097b-429a-81cd-8e23682387cd req-f4b1aa02-7f0a-42fa-9a4e-1b3f0f9b634f service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.397181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-805c2ee0-097b-429a-81cd-8e23682387cd req-f4b1aa02-7f0a-42fa-9a4e-1b3f0f9b634f service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.431061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-805c2ee0-097b-429a-81cd-8e23682387cd req-f4b1aa02-7f0a-42fa-9a4e-1b3f0f9b634f service nova] Creating event network-vif-plugged:d4f7e7d3-760a-499d-bf03-a692cff2b439 for instance 3104f831-5ba5-4ca1-a955-789bae89cb67 on hv-cinder-85220 Aug 31 05:19:42.431878 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-805c2ee0-097b-429a-81cd-8e23682387cd req-f4b1aa02-7f0a-42fa-9a4e-1b3f0f9b634f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 05:19:42.432399 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-805c2ee0-097b-429a-81cd-8e23682387cd req-f4b1aa02-7f0a-42fa-9a4e-1b3f0f9b634f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 05:19:42.433643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e26112c5-7706-441a-864f-07ed79474863 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.434319 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e26112c5-7706-441a-864f-07ed79474863 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.434945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e26112c5-7706-441a-864f-07ed79474863 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.435839 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e26112c5-7706-441a-864f-07ed79474863 None None] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.436425 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e26112c5-7706-441a-864f-07ed79474863 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.436977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e26112c5-7706-441a-864f-07ed79474863 None None] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.448436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.compute.rpcapi [None req-e26112c5-7706-441a-864f-07ed79474863 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 05:19:42.450351 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e26112c5-7706-441a-864f-07ed79474863 None None] Releasing lock "compute-rpcapi-router" {{(pid=120607) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 05:19:42.475228 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:42.475939 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:42.480753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e26112c5-7706-441a-864f-07ed79474863 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186333 Aug 31 05:19:42.483636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.484162 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.484573 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.485937 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.486753 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.487257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.490106 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 95/182] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:19:42.505942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:42.506814 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:42.519817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.520402 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.520826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.521669 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.522259 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.522632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.706391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:42.709680 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3eb8e5d2-1b19-408e-8a9b-9065c9d0dd4d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.238958 Aug 31 05:19:42.714542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 88/183] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:42 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:42.722218 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:42.722822 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:42.739076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.739809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.740489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.741494 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:42.744378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:42.745825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:42.775761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:42.788918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:42.790817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:42.791926 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ccd55ca8-fc8d-4405-afcc-ad1a9b18297d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.300640 Aug 31 05:19:42.806121 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 96/184] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:42 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:42.953368 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:42.962498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-86b890e9-3e8e-4e33-b5f2-374fbe4395e5 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.246528 Aug 31 05:19:42.964899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 89/185] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:42 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:43.734580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:43.735175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:43.741463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:43.741930 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:43.742378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:43.743041 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:43.743485 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:43.743906 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:43.816265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:43.816812 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:43.834045 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:43.834850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:43.835136 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:43.835999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:43.836738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:43.837377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:43.883936 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:43.892911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f17d9f9c-09b8-48fc-bcd3-f5fff3bdfa81 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.161946 Aug 31 05:19:43.893373 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 97/186] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:43 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:43.984806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:43.985939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:43.995797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:43.996300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:43.998900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:44.000825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:44.003705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:44.004310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:44.018934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:44.028215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:44.035824 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:44.037705 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8727183d-3e9b-4787-b227-c02f5ad5edc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.225488 Aug 31 05:19:44.039098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 90/187] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:43 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:44.205465 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:44.213836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5da865f0-8815-4856-985e-439bbb6508da tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.232951 Aug 31 05:19:44.214452 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 98/188] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:43 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:44.913119 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:44.914322 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:44.920722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:44.921202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:44.921626 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:44.922338 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:44.922783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:44.923324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:45.063734 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:45.065636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:45.075058 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:45.077309 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:45.077947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:45.080943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:45.081439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:45.081874 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:45.114487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:45.123400 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fe0e1726-d3b1-4b1d-8cf2-c16bfe1448bb tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.214310 Aug 31 05:19:45.134227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 91/189] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:44 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:45.234911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:45.236011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:45.242015 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:45.242640 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:45.243164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:45.244013 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:45.244462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:45.244876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:45.261380 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:45.263352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:45.271374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:45.274061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:45.275523 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b90fa44a-05c6-4545-ad95-9d3718ad0cc9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.216033 Aug 31 05:19:45.277047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 99/190] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:45 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:45.383598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:45.391705 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-649d4dbc-82bf-4ea9-b655-11dd223f5cab tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.161021 Aug 31 05:19:45.392240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 92/191] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:45 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:46.144720 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:46.145430 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:46.151683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:46.152406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:46.153020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:46.153905 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:46.154459 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:46.155085 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:46.299211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:46.299806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:46.307294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:46.308205 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:46.308661 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:46.309538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:46.309969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:46.310658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:46.314155 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:46.327149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7b003b68-e6ab-42d1-8ec0-20a751037587 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.186172 Aug 31 05:19:46.328086 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 100/192] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:46 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:46.412434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:46.413099 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:46.419203 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:46.419677 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:46.420157 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:46.420827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:46.421464 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:46.421876 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:46.817093 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:46.833242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:46.835207 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:46.842663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-68043384-207d-4e6c-9495-0b7ca1852649 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.547498 Aug 31 05:19:46.843249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 93/193] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:46 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:46.920793 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:46.929038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6473f543-8242-4d3d-a168-ca685dd52ea1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.520443 Aug 31 05:19:46.929706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 101/194] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:46 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:47.351427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:47.352037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:47.358656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:47.359482 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:47.360719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:47.361999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:47.362811 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:47.363227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:47.631527 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:47.639944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5786dbd4-e2df-4062-a861-5e24d7044b84 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.292217 Aug 31 05:19:47.640528 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 94/195] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:47 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:47.866427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:47.866998 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:47.873362 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:47.874037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:47.874610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:47.875600 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:47.880967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:47.880967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:47.950896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:47.951650 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:47.958576 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:47.959098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:47.959519 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:47.960201 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:47.960643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:47.961056 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:48.154546 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:48.166333 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:48.168809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:48.170446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0290b869-86a1-4eca-a1e7-3552ddf277b1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.308115 Aug 31 05:19:48.171365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 102/196] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:47 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:48.192801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:48.203633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-af12c6ba-9392-45bd-85a1-5c6fc3cb660d tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.257231 Aug 31 05:19:48.204945 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 95/197] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:47 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:48.661947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:48.662607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:48.672638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:48.673389 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:48.674061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:48.675153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:48.675697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:48.676209 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:48.857411 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:48.866278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-272797f8-88be-4026-bbdd-c7462238abde tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.208836 Aug 31 05:19:48.867391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 103/198] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:48 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:49.193770 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:49.194549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:49.200941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:49.201559 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:49.202126 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:49.203047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:49.203584 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:49.204095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:49.225252 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:49.226711 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:49.246827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:49.249797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:49.250265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:49.250967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:49.251439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:49.252022 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:49.280636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:49.468872 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:49.471886 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:49.480240 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-59b923b4-103b-4c41-9a1f-d4d8c184dd77 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.258895 Aug 31 05:19:49.481083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:49.481249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 104/199] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:49 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:49.483203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:49.484600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-52f956e7-75c7-432a-92c1-6c609da1a299 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.295172 Aug 31 05:19:49.485171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 96/200] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:49 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:49.889269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:49.889269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:49.894556 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:49.895034 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:49.895638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:49.896474 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:49.896918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:49.897327 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:50.099951 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:50.114503 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-dba65479-7db9-4875-9073-7fff8e010940 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.230486 Aug 31 05:19:50.128002 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 105/201] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:49 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:50.503730 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:50.504990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:50.509036 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:50.509641 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:50.515951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:50.518153 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:50.519984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:50.520405 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:50.520522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:50.521508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:50.523147 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:50.523733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:50.524414 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:50.526949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:50.527067 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:50.527723 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:50.895758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:50.897242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:50.908291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:50.910035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-af26cfda-e750-4f64-8e27-e06722820fc7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.410338 Aug 31 05:19:50.910392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:50.911572 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 97/202] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:50 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:50.912260 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4248e235-1920-4f9d-8dfd-21e705368049 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.408561 Aug 31 05:19:50.913381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 106/203] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:50 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:50.946701 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-0211323a-24ac-475d-8bd3-37fd535aa678 req-0da50568-16da-4d67-8761-7627176cafc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792990df-2cdb-403a-91cc-1a72056ff001", "name": "network-vif-plugged", "status": "completed", "tag": "f93ce3cf-db3b-4963-b0be-3e5b6226ff58"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:19:50.963298 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0211323a-24ac-475d-8bd3-37fd535aa678 req-0da50568-16da-4d67-8761-7627176cafc3 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:50.963773 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0211323a-24ac-475d-8bd3-37fd535aa678 req-0da50568-16da-4d67-8761-7627176cafc3 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:50.965222 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0211323a-24ac-475d-8bd3-37fd535aa678 req-0da50568-16da-4d67-8761-7627176cafc3 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:50.986233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-0211323a-24ac-475d-8bd3-37fd535aa678 req-0da50568-16da-4d67-8761-7627176cafc3 service nova] Creating event network-vif-plugged:f93ce3cf-db3b-4963-b0be-3e5b6226ff58 for instance 792990df-2cdb-403a-91cc-1a72056ff001 on hv-cinder-85220 Aug 31 05:19:50.991923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-0211323a-24ac-475d-8bd3-37fd535aa678 req-0da50568-16da-4d67-8761-7627176cafc3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057916 Aug 31 05:19:50.992728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 98/204] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:19:51.135519 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:51.136118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:51.142598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:51.143076 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:51.143496 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:51.144175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:51.144651 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:51.145022 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:51.297229 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:51.306731 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ee5df54a-3307-4d9c-9abb-4f9d6c88dd23 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.174647 Aug 31 05:19:51.307329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 107/205] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:51 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:51.934409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:51.937035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:51.937253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:51.938552 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:51.945722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:51.945934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:51.946592 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:51.946831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:51.947395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:51.948082 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:51.948291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:51.949043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:51.949327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:51.949880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:51.950139 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:51.950510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:52.376372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:52.380879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:52.388790 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-634f06bf-11c7-4936-a726-10e3e6a8579a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.459805 Aug 31 05:19:52.389892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:52.391451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:52.392559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4095e0c4-f9db-4a14-a3fe-8f4708915a97 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.459723 Aug 31 05:19:52.393412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 108/206] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:51 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:52.402066 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 99/207] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:51 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:52.409678 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:52.411039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:52.431995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:52.432683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:52.433264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:52.434147 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:52.434725 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:52.435310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:52.452633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:52.669276 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:52.678789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3de9c8c9-72b7-4876-b180-97f4eed7ef1a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.284162 Aug 31 05:19:52.679602 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 109/208] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:52 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:53.410833 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:53.412081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:53.415671 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:53.416278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:53.420631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:53.421374 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:53.422043 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:53.423353 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:53.424260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:53.424950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:53.427705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:53.428219 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:53.432436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:53.433399 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:53.434153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:53.434780 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:53.749943 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:53.754662 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:53.771443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:53.774101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:53.775950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ee81a2df-b523-4c07-abc4-258c6ca1c3a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.365111 Aug 31 05:19:53.777776 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 110/209] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:53 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:53.790957 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-79c122ac-36c1-4911-b001-d8c8741a7902 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.371378 Aug 31 05:19:53.795112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:53.796498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:53.805061 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 100/210] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:53 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:53.806888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:53.810660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:53.811515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:53.812676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:53.813333 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:53.813985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:54.263903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:54.272114 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1589348b-ad2d-4f6d-ab0e-c06862f88bd1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.492558 Aug 31 05:19:54.272804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 111/211] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:53 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:54.799873 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:54.800610 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:54.813603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:54.814953 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:54.835554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:54.836955 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:54.838490 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:54.839139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:54.843189 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:54.843992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:54.844968 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:54.845892 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:54.846584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:54.847239 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:54.848548 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:54.848784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:55.263823 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:55.270668 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:55.279297 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:55.281586 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-dc2b0bab-6523-4851-955d-12aa9da580f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.472919 Aug 31 05:19:55.282410 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 112/212] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:54 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:55.283697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:55.284965 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f58b3559-9daa-4ad4-b07d-2949c455c547 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.489635 Aug 31 05:19:55.285916 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 101/213] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:54 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:55.292667 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:55.293544 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:55.309755 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:55.310383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:55.310874 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:55.311782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:55.312443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:55.313041 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:55.536296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:55.548976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-76f2e38d-021d-45b3-8965-3b7e6cd57579 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.260074 Aug 31 05:19:55.550291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 113/214] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:55 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:56.308369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:56.309718 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:56.315605 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:56.316768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:56.317141 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:56.318797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:56.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:56.324832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:56.325508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:56.326251 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:56.326810 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:56.327308 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:56.327731 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:56.329434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:56.330268 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:56.331052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:56.603732 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:56.606169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:56.614962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:56.616383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:56.617492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-733a1846-536e-40a2-a672-e14fb8102ae6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.307636 Aug 31 05:19:56.629810 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 114/215] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:56 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:19:56.629810 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:56.629810 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:56.630093 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d7daa334-1b08-4a2f-aa26-b86d8fbedb2e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.322101 Aug 31 05:19:56.632143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:56.632833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:56.633426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:56.634318 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:56.634929 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:56.635339 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:56.638836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 102/216] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:56 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:56.883187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:56.896582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b85eb149-5a04-4b2b-a551-30ab5c055a3b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.275856 Aug 31 05:19:56.912771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 115/217] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:56 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:57.311568 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-95b1e195-1ef5-4936-abfc-537bb95514a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Action: 'create', calling method: .version_select at 0x7fbd0b6c6700>, body: {"keypair": {"name": "tempest-TestShelveInstance-928949727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1hnRE+ab3pGRv6VIURXou/M+TqQkUvC6r3paCQ+BfOidD6GA+8YJfHgbEmILURBvp1uNGP572r3j0AXoomlQj2KyuoeYm0WPAJ4cYUIXem7lNHdZNpopRpBZ4WexBjCQ=="}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:19:57.330924 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-95b1e195-1ef5-4936-abfc-537bb95514a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Getting quotas for project ae98273d8d0040b39ed83c8b7aee74a6. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:19:57.334655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-95b1e195-1ef5-4936-abfc-537bb95514a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Getting quotas for user a0063b9fa5dc4c3789db536f99a211fc and project ae98273d8d0040b39ed83c8b7aee74a6. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:19:57.370875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-95b1e195-1ef5-4936-abfc-537bb95514a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.255863 Aug 31 05:19:57.371434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 103/218] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:19:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:19:57.642426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:57.643191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:57.650952 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:57.651731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:57.654895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:57.655761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:57.656394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:57.657558 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:57.658311 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:57.659044 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:57.659169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:57.659627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:57.661261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:57.663055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:57.663529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:57.663884 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:57.886844 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:57.890220 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:57.897230 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:57.898973 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:57.900341 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6b4f4060-1d96-442f-8063-c5cf61782ddb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.261976 Aug 31 05:19:57.900870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-681f4d6e-2279-4a48-b6e9-2b97224b4f52 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.254697 Aug 31 05:19:57.901613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 104/219] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:57 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:57.901930 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 116/220] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:57 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:57.920470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:57.921082 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:57.927319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:57.927804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:57.928230 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:57.928914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:57.929354 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:57.929762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:58.075188 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:58.084439 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9b25706f-fdc4-47c6-9aca-0114c489ff9c tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.169078 Aug 31 05:19:58.085637 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 105/221] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:57 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:19:58.924336 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:58.924878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:58.925258 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:58.925455 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:58.931733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:58.932577 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:58.932761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:58.933300 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:58.934240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:58.934928 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:58.935567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:58.936458 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:58.936898 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:58.937602 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:58.938073 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:58.938493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:59.181817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:59.183441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:59.193982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3f5e469c-0c70-485c-8760-e260c35c540c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.273172 Aug 31 05:19:59.195339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 106/222] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:58 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:19:59.196249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:59.198769 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:59.200085 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fde141b7-6aa4-444e-8412-70d0ae7bbc28 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.279533 Aug 31 05:19:59.201070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:19:59.201831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:19:59.207920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:59.208607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:59.209180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:59.210072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:19:59.210652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:19:59.211259 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:19:59.214461 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 117/223] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:19:58 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:19:59.343824 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:19:59.351890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-252d182b-5054-4090-83d7-03f9937c7131 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.155368 Aug 31 05:19:59.352474 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 107/224] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:19:59 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:00.218194 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:00.219064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:00.225191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:00.225453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:00.225942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:00.226332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:00.226484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:00.227065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:00.227478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:00.227919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:00.234764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:00.235639 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:00.236132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:00.236888 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:00.237480 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:00.238128 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:00.435346 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:00.438636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:00.449376 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:00.450909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:00.451992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c983b4ad-cd55-4614-862b-b21b5bc16051 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.231809 Aug 31 05:20:00.452547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 108/225] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:20:00 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:20:00.457856 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6ad47c00-ab36-44b4-9dbe-62eff0bb682b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1363 microversion: 2.1 time: 0.245170 Aug 31 05:20:00.458464 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 118/226] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:00 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:00.462415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:00.463012 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:00.468785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:00.469263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:00.469777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:00.470513 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:00.470951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:00.471356 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:00.619044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:00.627425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-527e1142-d145-4a86-b0f2-1714f73e0d43 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.173871 Aug 31 05:20:00.628497 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 109/227] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:00 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:01.474564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:01.475203 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:01.479053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:01.479827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:01.482634 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:01.483378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:01.483606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:01.484536 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:01.485348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:01.485913 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:01.488437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:01.490083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:01.490693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:01.491657 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:01.492715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:01.492715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:01.705432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:01.709143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:01.713928 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d2fef71f-9407-42f9-b616-1e0273ddb76a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1548 microversion: 2.1 time: 0.239252 Aug 31 05:20:01.714596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:01.715887 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 110/228] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:01 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:01.721076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:01.721884 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:01.729300 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:01.729981 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:01.730594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:01.731458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:01.731938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:01.732353 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:01.742921 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:01.745363 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:01.747349 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-24219b3b-ba2e-40d8-99e7-b477a3ca6ab9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.277019 Aug 31 05:20:01.748255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 119/229] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:20:01 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:20:01.756118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:01.756753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:01.773942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:01.774469 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:01.774892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:01.775652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:01.777834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:01.778311 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:01.935912 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-efa13b34-7925-4bba-9526-e2bdc3e9c656 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185937 Aug 31 05:20:01.936556 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 120/230] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 05:20:01 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:20:01.959358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:01.968690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-41529e6b-d1f6-4fc4-a955-99106ff2fc33 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.250628 Aug 31 05:20:01.969521 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 111/231] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:01 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:02.776140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:02.777438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:02.784686 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:02.785337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:02.785914 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:02.786806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:02.787394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:02.787962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:02.810319 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:02.985351 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:02.990076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:02.992380 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:03.000224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:03.002432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:03.003758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-668f35da-1736-43d9-af18-feac7c70a5e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.235264 Aug 31 05:20:03.004803 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 121/232] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:20:02 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:20:03.006706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:03.007195 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:03.007622 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:03.008319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:03.008764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:03.009175 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:03.141550 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-06aa1832-983d-4b12-be74-e45ee4eea3ed req-38a2c673-3b71-4fff-ba98-1923dd70556a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b209be4-6027-4328-a956-5deea7de1a64", "name": "network-vif-plugged", "status": "completed", "tag": "918fbec4-f9a6-4f49-98c8-ddb91a52e37a"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:03.161937 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-06aa1832-983d-4b12-be74-e45ee4eea3ed req-38a2c673-3b71-4fff-ba98-1923dd70556a service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:03.168551 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-06aa1832-983d-4b12-be74-e45ee4eea3ed req-38a2c673-3b71-4fff-ba98-1923dd70556a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:03.169138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-06aa1832-983d-4b12-be74-e45ee4eea3ed req-38a2c673-3b71-4fff-ba98-1923dd70556a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:03.194573 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-06aa1832-983d-4b12-be74-e45ee4eea3ed req-38a2c673-3b71-4fff-ba98-1923dd70556a service nova] Creating event network-vif-plugged:918fbec4-f9a6-4f49-98c8-ddb91a52e37a for instance 5b209be4-6027-4328-a956-5deea7de1a64 on hv-cinder-85220 Aug 31 05:20:03.205054 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-06aa1832-983d-4b12-be74-e45ee4eea3ed req-38a2c673-3b71-4fff-ba98-1923dd70556a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067141 Aug 31 05:20:03.206155 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 122/233] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:20:03.237940 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:03.250058 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0c437156-f994-4404-a89e-869a976043cf tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.264059 Aug 31 05:20:03.253205 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 112/234] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:02 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:20:03.791329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-74e8e466-39db-4c32-95d2-6b1c98b035e7 req-fc8e79d9-6bc3-4b85-8e1c-8a41d800503e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3104f831-5ba5-4ca1-a955-789bae89cb67", "tag": "d4f7e7d3-760a-499d-bf03-a692cff2b439"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:03.801075 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-74e8e466-39db-4c32-95d2-6b1c98b035e7 req-fc8e79d9-6bc3-4b85-8e1c-8a41d800503e service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:03.801638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-74e8e466-39db-4c32-95d2-6b1c98b035e7 req-fc8e79d9-6bc3-4b85-8e1c-8a41d800503e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:03.802186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-74e8e466-39db-4c32-95d2-6b1c98b035e7 req-fc8e79d9-6bc3-4b85-8e1c-8a41d800503e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:03.814877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-74e8e466-39db-4c32-95d2-6b1c98b035e7 req-fc8e79d9-6bc3-4b85-8e1c-8a41d800503e service nova] Creating event network-changed:d4f7e7d3-760a-499d-bf03-a692cff2b439 for instance 3104f831-5ba5-4ca1-a955-789bae89cb67 on hv-cinder-85220 Aug 31 05:20:03.819999 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-74e8e466-39db-4c32-95d2-6b1c98b035e7 req-fc8e79d9-6bc3-4b85-8e1c-8a41d800503e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032921 Aug 31 05:20:03.820871 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 123/235] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:20:04.031079 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:04.031079 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:04.043276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:04.050763 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:04.051356 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:04.052190 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:04.052745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:04.054038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:04.274112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:04.275213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:04.290585 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:04.290585 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:04.290585 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:04.293327 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:04.298535 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:04.299138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:04.380526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:04.389602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:04.391067 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:04.400685 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-feab4d3a-e70d-4747-b689-98474784ff00 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.377507 Aug 31 05:20:04.404827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 113/236] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:20:04 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:20:04.573387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:04.582332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e1793c8a-c003-4a08-8128-64845937a4f4 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1315 microversion: 2.1 time: 0.312335 Aug 31 05:20:04.583397 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 124/237] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:04 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:20:05.429490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:05.430386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:05.433702 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:05.445914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:05.447166 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:05.447598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:05.448418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:05.448976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:05.450162 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:05.604170 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:05.604847 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:05.617419 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:05.618098 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:05.618687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:05.619523 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:05.620102 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:05.620650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:05.722297 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:05.739160 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:05.743665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:05.745001 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a9526b44-03e7-43e1-bff6-97b2d839192a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.319700 Aug 31 05:20:05.748432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 114/238] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:20:05 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:20:05.865506 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:05.875381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-47a01112-ba7b-4e95-be78-ec562ff2d32b tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1503 microversion: 2.1 time: 0.275418 Aug 31 05:20:05.876329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 125/239] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:05 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:20:06.774424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:06.776636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:06.785887 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:06.786681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:06.787654 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:06.788825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:06.789742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:06.790507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:06.941310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:06.951253 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:06.952681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:06.953802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-70331d55-ffa6-468e-a151-c64caa6b59a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1405 microversion: 2.20 time: 0.187229 Aug 31 05:20:06.954409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 115/240] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:20:06 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:20:07.596359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b84b432-a89c-495a-9871-1bda7f117d99"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:07.598765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:07.605185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:07.605914 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:07.606566 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:07.607428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:07.608049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:07.608644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:07.973874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=4 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:07.978799 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:07.979424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:07.992495 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:07.993152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:07.993452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:07.996337 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:07.998109 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:07.998737 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:08.074699 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-27faa80f-8e7a-42a6-ab02-4728885b8ff9 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "POST /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482098 Aug 31 05:20:08.081094 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 126/241] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:20:07 2022] POST /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:20:08.293358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:08.306053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:08.312159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:08.313396 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4e38cfe2-b37e-48d8-93e7-171899a79c7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1597 microversion: 2.20 time: 0.340307 Aug 31 05:20:08.313953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 116/242] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:20:07 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1597 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:20:08.340701 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:08.341632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:08.348856 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:08.349432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:08.349864 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:08.350582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:08.351028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:08.351734 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:08.456477 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ff5293c3-3e68-4a1d-8f7c-206fc6cadac1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122188 Aug 31 05:20:08.457071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 127/243] 10.222.0.36 () {60 vars in 1316 bytes} [Wed Aug 31 05:20:08 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:20:09.987217 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-0755872f-b8a4-4582-b81e-e2b137d84c0c req-c34d41c0-b2d4-4064-af83-d1b61c51f249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b209be4-6027-4328-a956-5deea7de1a64", "tag": "918fbec4-f9a6-4f49-98c8-ddb91a52e37a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:10.003357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0755872f-b8a4-4582-b81e-e2b137d84c0c req-c34d41c0-b2d4-4064-af83-d1b61c51f249 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:10.003833 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0755872f-b8a4-4582-b81e-e2b137d84c0c req-c34d41c0-b2d4-4064-af83-d1b61c51f249 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:10.004250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0755872f-b8a4-4582-b81e-e2b137d84c0c req-c34d41c0-b2d4-4064-af83-d1b61c51f249 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:10.019233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-0755872f-b8a4-4582-b81e-e2b137d84c0c req-c34d41c0-b2d4-4064-af83-d1b61c51f249 service nova] Creating event network-changed:918fbec4-f9a6-4f49-98c8-ddb91a52e37a for instance 5b209be4-6027-4328-a956-5deea7de1a64 on hv-cinder-85220 Aug 31 05:20:10.029544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-0755872f-b8a4-4582-b81e-e2b137d84c0c req-c34d41c0-b2d4-4064-af83-d1b61c51f249 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048054 Aug 31 05:20:10.033320 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 117/244] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:20:22.466242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=65 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:22.467324 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:22.471143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:22.471821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:22.479873 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:22.480351 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:22.481010 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:22.481692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:22.482170 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:22.482584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:22.512792 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Going to try to terminate instance {{(pid=120607) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:20:22.624005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ecd3678a-d099-44d5-a846-b5f852e01757 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 204 len: 0 microversion: 2.1 time: 0.159288 Aug 31 05:20:22.624926 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 128/245] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:20:22 2022] DELETE /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:20:22.633554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:22.634291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:22.636525 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=7 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:22.649425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=38 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:22.655805 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:22.656626 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:22.657296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:22.658254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:22.658913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:22.659533 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:22.806333 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:22.815170 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5040a542-c140-418e-9b96-0bf729cc025e tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1555 microversion: 2.1 time: 0.185705 Aug 31 05:20:22.815679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 118/246] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:22 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:20:23.842243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:23.843825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:23.852193 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:23.852877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:23.853353 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:23.854123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:23.854619 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:23.855235 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:24.261300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:24.277037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d8b1ea01-7248-419a-b3d5-fd3ae8543d27 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1555 microversion: 2.1 time: 0.439259 Aug 31 05:20:24.277858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 129/247] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:23 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1555 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:25.299418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:25.300887 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:25.308935 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:25.309945 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:25.310485 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:25.311683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:25.312404 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:25.313363 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:25.517063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:25.539372 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-19673d9b-822d-4071-81aa-82138e935305 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1555 microversion: 2.1 time: 0.242793 Aug 31 05:20:25.542643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 119/248] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:25 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:26.260012 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-968b3be1-4565-4d29-bf1b-bff3310b24a8 req-9605fab6-1f1e-403c-8394-efe02ec917a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792990df-2cdb-403a-91cc-1a72056ff001", "name": "network-vif-deleted", "tag": "f93ce3cf-db3b-4963-b0be-3e5b6226ff58"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:26.304787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-968b3be1-4565-4d29-bf1b-bff3310b24a8 req-9605fab6-1f1e-403c-8394-efe02ec917a5 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:26.306626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-968b3be1-4565-4d29-bf1b-bff3310b24a8 req-9605fab6-1f1e-403c-8394-efe02ec917a5 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:26.310173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-968b3be1-4565-4d29-bf1b-bff3310b24a8 req-9605fab6-1f1e-403c-8394-efe02ec917a5 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:26.339989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-968b3be1-4565-4d29-bf1b-bff3310b24a8 req-9605fab6-1f1e-403c-8394-efe02ec917a5 service nova] Creating event network-vif-deleted:f93ce3cf-db3b-4963-b0be-3e5b6226ff58 for instance 792990df-2cdb-403a-91cc-1a72056ff001 on hv-cinder-85220 Aug 31 05:20:26.347133 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-968b3be1-4565-4d29-bf1b-bff3310b24a8 req-9605fab6-1f1e-403c-8394-efe02ec917a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093014 Aug 31 05:20:26.348410 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 130/249] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:20:26.561845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:26.563603 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:26.571069 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:26.571764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:26.572841 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:26.574544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:26.575434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:26.575920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:26.666690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e6e2487fce4c03a8770443791c5b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a0d4c08d8044b1ab696dc757ba1a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:26.676956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4673656c-0c6a-48eb-aa9e-66547404820a tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 200 len: 1346 microversion: 2.1 time: 0.119907 Aug 31 05:20:26.677554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 120/250] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:26 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:27.699007 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:27.699901 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:27.708977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:27.709453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:27.710590 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:27.711904 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:27.712470 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:27.713033 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:27.728882 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] HTTP exception thrown: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Request method failure captured: Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 HTTP/1.1 Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu8w27TFoS6bsJrdwQLfwXvqaPTxysufqh6fvf1gpxhCIm0BybzM-1kdctCzDsWhYn6M_2lLt-GEJhjadpqalw3CzGMG2xRroinPpvayH_nN-GiQZrV2J0tczNsolpRHLILXv9fB1eroC3l9siQbu7RNGnNsiID0EwItQArpEU4EdKo Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 44a0d4c08d8044b1ab696dc757ba1a4d Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:20:27.733806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_44a0d4c08d8044b1ab696dc757ba1a4d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 44a0d4c08d8044b1ab696dc757ba1a4d Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-DeleteServersTestJSON-1208087144-project Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 69e6e2487fce4c03a8770443791c5b8a Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-DeleteServersTestJSON-1208087144-project Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.735687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '792990df-2cdb-403a-91cc-1a72056ff001'} Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:20:27.736658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.738281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.739747 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Returning 404 to user: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:20:27.739747 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a45884b3-3e29-4547-9bce-ba2c7176b06d tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 404 len: 111 microversion: 2.1 time: 0.041991 Aug 31 05:20:27.739747 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 131/251] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:27 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 05:20:27.875209 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:27.877442 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:27.883876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:27.884471 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:27.884892 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:27.885562 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:27.885999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:27.886427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:27.934305 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] HTTP exception thrown: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Request method failure captured: Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001/os-volume_attachments HTTP/1.1 Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu8w27TFoS6bsJrdwQLfwXvqaPTxysufqh6fvf1gpxhCIm0BybzM-1kdctCzDsWhYn6M_2lLt-GEJhjadpqalw3CzGMG2xRroinPpvayH_nN-GiQZrV2J0tczNsolpRHLILXv9fB1eroC3l9siQbu7RNGnNsiID0EwItQArpEU4EdKo Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 44a0d4c08d8044b1ab696dc757ba1a4d Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:20:27.938388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_44a0d4c08d8044b1ab696dc757ba1a4d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 44a0d4c08d8044b1ab696dc757ba1a4d Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-DeleteServersTestJSON-1208087144-project Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 69e6e2487fce4c03a8770443791c5b8a Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-DeleteServersTestJSON-1208087144-project Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.939607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'server_id': '792990df-2cdb-403a-91cc-1a72056ff001'} Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:20:27.940340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:27.941829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:27.943183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Returning 404 to user: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:20:27.943183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-128926f7-1a83-490c-a891-2118f1b745f1 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068904 Aug 31 05:20:27.943183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 121/252] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:20:27 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001/os-volume_attachments => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 05:20:28.761379 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1205952120", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "networks": [{"uuid": "0bd5033b-afa0-4bbd-bae1-89210deb8646"}]}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:28.825138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.network.neutron [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] validate_networks() for [('0bd5033b-afa0-4bbd-bae1-89210deb8646', None, None, None, None, None)] {{(pid=120607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:20:29.197085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:29.197762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:29.205432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:29.205914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:29.206364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:29.207053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:29.207564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:29.211270 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:29.230150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] HTTP exception thrown: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Request method failure captured: Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 HTTP/1.1 Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu8w27TFoS6bsJrdwQLfwXvqaPTxysufqh6fvf1gpxhCIm0BybzM-1kdctCzDsWhYn6M_2lLt-GEJhjadpqalw3CzGMG2xRroinPpvayH_nN-GiQZrV2J0tczNsolpRHLILXv9fB1eroC3l9siQbu7RNGnNsiID0EwItQArpEU4EdKo Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 44a0d4c08d8044b1ab696dc757ba1a4d Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:20:29.232648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_44a0d4c08d8044b1ab696dc757ba1a4d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 44a0d4c08d8044b1ab696dc757ba1a4d Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-DeleteServersTestJSON-1208087144-project Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 69e6e2487fce4c03a8770443791c5b8a Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-DeleteServersTestJSON-1208087144-project Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.234197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '792990df-2cdb-403a-91cc-1a72056ff001'} Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:20:29.235335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.236449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.238645 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Returning 404 to user: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:20:29.239687 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-81806f1c-f7cd-40a6-bf21-f3fce2b40ee2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "DELETE /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 404 len: 111 microversion: 2.1 time: 0.046639 Aug 31 05:20:29.243358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 122/253] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:20:29 2022] DELETE /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:20:29.248215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:29.248817 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] [instance: 792990df-2cdb-403a-91cc-1a72056ff001] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:29.248934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Flavor limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:20:29.249292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Image limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:20:29.249755 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Flavor pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:20:29.250174 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Image pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:20:29.250567 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:20:29.254727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:29.255380 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:29.255991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:29.256853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:29.257474 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:29.258142 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:29.259938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:29.260401 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:29.260813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:29.262027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:29.262527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:29.263013 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:29.272869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] HTTP exception thrown: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Request method failure captured: Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 HTTP/1.1 Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu8w27TFoS6bsJrdwQLfwXvqaPTxysufqh6fvf1gpxhCIm0BybzM-1kdctCzDsWhYn6M_2lLt-GEJhjadpqalw3CzGMG2xRroinPpvayH_nN-GiQZrV2J0tczNsolpRHLILXv9fB1eroC3l9siQbu7RNGnNsiID0EwItQArpEU4EdKo Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 44a0d4c08d8044b1ab696dc757ba1a4d Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:20:29.274413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_44a0d4c08d8044b1ab696dc757ba1a4d", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/44a0d4c08d8044b1ab696dc757ba1a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 44a0d4c08d8044b1ab696dc757ba1a4d Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-DeleteServersTestJSON-1208087144 Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-DeleteServersTestJSON-1208087144-project Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 69e6e2487fce4c03a8770443791c5b8a Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-DeleteServersTestJSON-1208087144-project Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.275594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '792990df-2cdb-403a-91cc-1a72056ff001'} Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:20:29.276249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. Aug 31 05:20:29.277429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:20:29.278489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] Returning 404 to user: Instance 792990df-2cdb-403a-91cc-1a72056ff001 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:20:29.278489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-64d37015-acc9-4f79-8e1b-ee49d2ec01e2 tempest-DeleteServersTestJSON-1208087144 tempest-DeleteServersTestJSON-1208087144-project] 10.222.0.36 "GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001" status: 404 len: 111 microversion: 2.1 time: 0.031292 Aug 31 05:20:29.278489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 123/254] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:29 2022] GET /compute/v2.1/servers/792990df-2cdb-403a-91cc-1a72056ff001 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:20:29.292384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Getting quotas for project 04da0465aa794d208d6dd9e2aab7d704. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:20:29.296505 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Getting quotas for user 9d7f48e1763e4ff3b77ddb90e65045b0 and project 04da0465aa794d208d6dd9e2aab7d704. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:20:29.311151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Going to run 1 instances... {{(pid=120607) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:20:29.314339 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:20:29.376902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-eb46ba96-0737-47b0-a5b3-cdfde210f22a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619305 Aug 31 05:20:29.378343 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 132/255] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:20:29.389719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f21a3132-10ad-4980-9538-82e10a34228c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:29.390366 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f21a3132-10ad-4980-9538-82e10a34228c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:29.478438 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f21a3132-10ad-4980-9538-82e10a34228c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:29.496440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f21a3132-10ad-4980-9538-82e10a34228c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1214 microversion: 2.1 time: 0.111267 Aug 31 05:20:29.497170 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 124/256] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:29 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:30.517413 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:30.518196 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:30.545168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:30.545943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:30.546597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:30.547949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:30.549839 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:30.550452 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:30.752595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:30.760443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-039f0ec5-dec5-4deb-91ba-890be8182cc1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1266 microversion: 2.1 time: 0.247302 Aug 31 05:20:30.768038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 133/257] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:30 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:31.780860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:31.782077 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:31.789485 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:31.791227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:31.792041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:31.795085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:31.795748 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:31.797599 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:31.925215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:31.952773 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4bb1dd7e-85ca-4d05-9ca1-c4f78ce62011 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1272 microversion: 2.1 time: 0.175586 Aug 31 05:20:31.969047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 125/258] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:31 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:32.979643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-81f0f950-c314-4364-ac26-d4aff2b13261 req-61b6e477-6e3f-42d1-b856-f40b9a07f1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba", "tag": "11a1013b-8b7b-45e4-805e-4472b37e2449"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:32.987985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:32.993587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:33.004860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-81f0f950-c314-4364-ac26-d4aff2b13261 req-61b6e477-6e3f-42d1-b856-f40b9a07f1f7 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:33.005167 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:33.005341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-81f0f950-c314-4364-ac26-d4aff2b13261 req-61b6e477-6e3f-42d1-b856-f40b9a07f1f7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:33.005768 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-81f0f950-c314-4364-ac26-d4aff2b13261 req-61b6e477-6e3f-42d1-b856-f40b9a07f1f7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:33.006198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:33.006962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:33.008245 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:33.008841 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:33.009398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:33.051623 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-81f0f950-c314-4364-ac26-d4aff2b13261 req-61b6e477-6e3f-42d1-b856-f40b9a07f1f7 service nova] Creating event network-changed:11a1013b-8b7b-45e4-805e-4472b37e2449 for instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba on hv-cinder-85220 Aug 31 05:20:33.058751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-81f0f950-c314-4364-ac26-d4aff2b13261 req-61b6e477-6e3f-42d1-b856-f40b9a07f1f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084448 Aug 31 05:20:33.059666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 126/259] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:20:33.332970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:33.353295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-dd02e8bd-dc1f-4874-b3e2-ccc080d30795 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.378875 Aug 31 05:20:33.354765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 134/260] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:32 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:34.376976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:34.377795 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:34.385959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:34.387895 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:34.387895 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:34.388966 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:34.390041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:34.390820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:34.746838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:34.762787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a140e4e8-fd6a-41b6-b6cf-b59beb4de56e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.391178 Aug 31 05:20:34.764004 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 127/261] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:34 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:20:35.784582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:35.785914 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:35.793136 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:35.793614 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:35.794054 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:35.795490 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:35.796078 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:35.796831 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:35.951132 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:35.959003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0e6145a6-98bd-4446-a579-b548406e6140 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.179226 Aug 31 05:20:35.969064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 135/262] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:35 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:36.615083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1544671129", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-928949727", "security_groups": [{"name": "tempest-secgroup-smoke-1065364791"}], "networks": [{"uuid": "dea1c8d3-d0bb-4761-81b1-12c4434b8f57"}], "block_device_mapping_v2": [{"uuid": "fbffb9e6-8477-4fa9-930c-9428569af29c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:36.788122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] validate_networks() for [('dea1c8d3-d0bb-4761-81b1-12c4434b8f57', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:20:36.979221 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:36.979937 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:36.987345 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:36.987996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:36.988512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:36.989296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:36.989832 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:36.990451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:37.430234 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:37.438973 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9e264be4-1852-4a7c-879a-964d69c72a64 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.463551 Aug 31 05:20:37.452391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 136/263] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:36 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:37.815266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:20:37.816159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:20:37.817185 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:20:37.818042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:20:37.819160 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:20:37.831089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:37.831666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:37.832595 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:37.833628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:37.834656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:37.835931 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:37.854972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Getting quotas for project ae98273d8d0040b39ed83c8b7aee74a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:20:37.861759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Getting quotas for user a0063b9fa5dc4c3789db536f99a211fc and project ae98273d8d0040b39ed83c8b7aee74a6. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:20:37.953492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:20:37.955606 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbffb9e6-8477-4fa9-930c-9428569af29c',volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:20:38.163993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eec4a057-03a4-41b8-a13c-7bd8f4844bc7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.553083 Aug 31 05:20:38.164649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 128/264] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:20:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:20:38.181194 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c500c465-911a-4982-9ba8-1d2efedf73b9 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:38.181755 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c500c465-911a-4982-9ba8-1d2efedf73b9 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:38.276866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c500c465-911a-4982-9ba8-1d2efedf73b9 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:38.290228 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c500c465-911a-4982-9ba8-1d2efedf73b9 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1088 microversion: 2.1 time: 0.115469 Aug 31 05:20:38.290838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 137/265] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:38 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1088 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:38.461245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:38.462470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:38.486266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:38.487492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:38.488767 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:38.490965 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:38.498234 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:38.500166 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:38.756643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:38.781556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-75721768-95b9-4625-a928-f51900ea0338 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.325248 Aug 31 05:20:38.795547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 129/266] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:38 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:39.311435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:39.312261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:39.315853 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:39.327162 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:39.339844 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:39.340761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:39.342631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:39.343554 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:39.346086 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:39.494282 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:39.520897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-407d0b0e-6312-4755-a8a1-59a089a4bdc5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1138 microversion: 2.1 time: 0.213500 Aug 31 05:20:39.523954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 138/267] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:39 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1138 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:39.804440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:39.805629 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:39.812205 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:39.813214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:39.813335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:39.813998 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:39.814517 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:39.814871 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:40.059940 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:40.069112 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-661681ef-7aac-4313-b579-3f9fdec439b4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.270134 Aug 31 05:20:40.070764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 130/268] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:39 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:40.545247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:40.546515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:40.575434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:40.575927 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:40.583632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:40.584946 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:40.585753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:40.588163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:40.726873 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:40.739668 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e831e6cc-c0d5-421a-8052-5ec6332ed058 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1138 microversion: 2.1 time: 0.195931 Aug 31 05:20:40.754156 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 139/269] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:40 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1138 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:41.091531 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:41.094288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:41.106325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:41.106799 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:41.107284 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:41.108022 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:41.109885 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:41.110329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:41.366989 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:41.375623 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-967bcc6c-ddf6-48c9-8cc3-6e4193c7a285 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.288030 Aug 31 05:20:41.376373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 131/270] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:41 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:41.761082 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:41.762560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:41.769588 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:41.770157 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:41.770576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:41.771215 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:41.771816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:41.772412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:41.839127 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:41.847291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a8ce12dd-1ea7-40c3-a899-2331d43b9c8b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1138 microversion: 2.1 time: 0.090745 Aug 31 05:20:41.847866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 140/271] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:41 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:41.957349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-932223187", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:42.014247 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] validate_networks() for [('991f8f30-a46a-43d2-914e-94c76b2ab494', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:20:42.392860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:20:42.393452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:20:42.393728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:20:42.394170 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:20:42.394592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:20:42.396300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:42.396825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:42.403279 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:42.403649 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:42.404139 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:42.404821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:42.404965 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:42.405285 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:42.405428 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:42.405737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:42.405839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:42.406843 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:42.407276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:42.407681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:42.425002 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Getting quotas for project 597fddc7874a4133987f79807674561f. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:20:42.428915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Getting quotas for user 806b011517ef4201a86c90472e0740d6 and project 597fddc7874a4133987f79807674561f. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:20:42.440361 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:20:42.443355 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:20:42.501198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f94fda89-0a15-4359-bcec-4ab3c3d0b8df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.663708 Aug 31 05:20:42.502529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 132/272] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:20:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 05:20:42.515413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6eca36ff-7f3e-4732-bd00-4220c63717f6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:42.516369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6eca36ff-7f3e-4732-bd00-4220c63717f6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:42.805829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6eca36ff-7f3e-4732-bd00-4220c63717f6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:42.814991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6eca36ff-7f3e-4732-bd00-4220c63717f6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1221 microversion: 2.1 time: 0.304432 Aug 31 05:20:42.816412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 133/273] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:42 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1221 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:42.821105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:42.829003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f6ea0842-52b2-45b5-97cc-c0b4b712fa2e tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.436816 Aug 31 05:20:42.829564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 141/274] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:42 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:20:42.870232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:42.870880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:42.879050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:42.879641 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:42.880159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:42.880886 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:42.881524 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:42.882177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:42.883997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-564356062", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:20:42.941607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.network.neutron [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] validate_networks() for [('991f8f30-a46a-43d2-914e-94c76b2ab494', None, None, None, None, None)] {{(pid=120607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:20:42.969647 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:42.979729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a7ea5ced-e781-4bd6-bd3b-5ac3bdc498f7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1138 microversion: 2.1 time: 0.114399 Aug 31 05:20:42.980896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 134/275] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:42 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1138 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:43.339698 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Flavor limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:20:43.340107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Image limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:20:43.340561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Flavor pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:20:43.340974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Image pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:20:43.341371 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:20:43.349950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:43.350453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:43.350877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:43.351582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:43.352025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:43.352433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:43.369149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Getting quotas for project 597fddc7874a4133987f79807674561f. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:20:43.372924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Getting quotas for user 806b011517ef4201a86c90472e0740d6 and project 597fddc7874a4133987f79807674561f. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:20:43.383480 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Going to run 1 instances... {{(pid=120607) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:20:43.385620 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:20:43.435064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-30400532-abdc-41f1-906e-094dd1525a2c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.555254 Aug 31 05:20:43.435064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 142/276] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:20:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:20:43.445199 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8584a349-4718-4585-8c45-74eefca3469d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:43.446506 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8584a349-4718-4585-8c45-74eefca3469d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:43.527388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8584a349-4718-4585-8c45-74eefca3469d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:43.534663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8584a349-4718-4585-8c45-74eefca3469d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1221 microversion: 2.1 time: 0.093201 Aug 31 05:20:43.548080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 135/277] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:43 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:43.849634 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:43.850233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:43.858499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:43.860045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:43.861065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:43.863146 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:43.863822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:43.864454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:44.001324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:44.001930 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:44.011379 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:44.011878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:44.012308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:44.013001 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:44.013448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:44.013860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:44.085081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:44.100455 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-746ea7df-2c47-4a51-9ae9-80b3f19ee298 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.253427 Aug 31 05:20:44.101231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 143/278] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:43 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:44.136058 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:44.144195 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5e7ba44d-3510-4104-898c-8668c790a00c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1186 microversion: 2.1 time: 0.147013 Aug 31 05:20:44.147112 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 136/279] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:43 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1186 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:20:44.555891 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:44.556800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:44.579909 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:44.580740 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:44.584260 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:44.587639 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:44.588128 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:44.588636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:44.688630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:44.696855 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bd95e689-044e-40b1-b112-d21d3eedba28 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.145221 Aug 31 05:20:44.697778 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 144/280] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:44 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:45.122331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:45.122911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:45.129500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:45.129994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:45.130455 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:45.131146 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:45.131632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:45.132049 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:45.167513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:45.168107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:45.185099 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:45.185597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:45.186206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:45.186938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:45.187352 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:45.187762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:45.273193 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:45.281301 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1ad53264-af55-4b44-a063-170ca167ffd6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.117557 Aug 31 05:20:45.281897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 145/281] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:45 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:45.320011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:45.328287 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7d721cf7-8b65-41fa-bb2a-bf82ed7ff17c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.209948 Aug 31 05:20:45.329086 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 137/282] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:45 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:45.720854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:45.721834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:45.731173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:45.731679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:45.732104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:45.732772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:45.733210 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:45.733621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:45.752387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:45.802040 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:45.809939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-403af094-467d-4aed-9c86-0bb26fec65b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.095509 Aug 31 05:20:45.810534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 146/283] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:45 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:46.306061 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:46.306745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:46.316375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:46.317121 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:46.317816 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:46.318859 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:46.319545 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:46.320179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:46.352406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:46.353205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:46.361576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:46.362361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:46.362790 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:46.363477 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:46.364159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:46.364733 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:46.388650 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:46.396281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-897f9c96-55c4-424a-bbb4-cf37223327ac tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.096840 Aug 31 05:20:46.397114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 138/284] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:46 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:46.502772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:46.511750 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-afc62829-502d-4ad8-b3ed-8507f8a8e465 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.164302 Aug 31 05:20:46.522133 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 147/285] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:46 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:46.834053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:46.834821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:46.842624 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:46.843097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:46.843516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:46.844214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:46.844659 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:46.845065 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:46.907964 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:46.915958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fbccbefd-2e2f-4ed4-b456-1334b20e6783 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.088299 Aug 31 05:20:46.916522 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 139/286] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:46 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:47.421321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:47.422300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:47.433488 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:47.433945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:47.434405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:47.435086 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:47.435577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:47.436049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:47.510291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:47.518630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d1b8e9fb-8d1b-49b7-b23e-a21531535eeb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.103823 Aug 31 05:20:47.519201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 148/287] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:47 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:47.532809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:47.533462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:47.540003 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:47.540485 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:47.540893 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:47.541575 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:47.542036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:47.542512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:47.678565 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:47.686328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9dd45390-4b0b-4f86-b0be-1c69ac8f7104 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.157370 Aug 31 05:20:47.686838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 140/288] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:47 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:47.941248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:47.942144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:47.950927 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:47.951400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:47.951816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:47.952510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:47.952944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:47.953348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:48.020687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:48.028465 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0ff1aad7-be79-47fe-bf15-0376928cdc0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.093708 Aug 31 05:20:48.029027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 149/289] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:47 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:48.539738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:48.540339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:48.547361 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:48.547843 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:48.548271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:48.548950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:48.549394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:48.549808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:48.572735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:48.625580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:48.633464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ea8e08f7-9571-4b11-9237-4cfcf2d00998 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.097608 Aug 31 05:20:48.634189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 141/290] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:48 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:48.706630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:48.707254 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:48.714338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:48.714809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:48.715222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:48.715879 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:48.716314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:48.716717 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:48.856797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:48.864961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-47fef544-3c0b-49ee-9706-f7ab6b29a82c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.162082 Aug 31 05:20:48.865533 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 150/291] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:48 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:49.053329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:49.054364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:49.061926 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:49.062441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:49.062828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:49.063567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:49.064013 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:49.064458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:49.127477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:49.135361 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-189ea1dd-4ab7-4ebb-b5c5-c50830bc435a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.088581 Aug 31 05:20:49.135981 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 142/292] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:49 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:49.656172 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:49.656775 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:49.665019 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:49.665499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:49.665971 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:49.666680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:49.667116 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:49.667519 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:49.728962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:49.737142 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c8593738-4d19-4940-be34-323fe6d0fa39 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.086075 Aug 31 05:20:49.737706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 151/293] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:49 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:49.888411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:49.889105 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:49.895877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:49.896407 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:49.896876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:49.897632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:49.898176 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:49.898636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:50.046883 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:50.054690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ff236b53-e54e-439d-86cf-b67426b083cd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.171726 Aug 31 05:20:50.055255 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 143/294] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:49 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:50.155953 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:50.156548 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:50.162994 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:50.163466 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:50.163894 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:50.164560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:50.165001 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:50.165410 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:50.228974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:50.238257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-aeb63b1d-97dd-4738-8d03-4b599ccf15d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.086143 Aug 31 05:20:50.238819 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 152/295] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:50 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:50.759335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:50.760162 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:50.766844 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:50.767367 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:50.767785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:50.768440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:50.768877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:50.769285 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:50.829874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:50.837618 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4cfe4d06-1b22-44f2-893f-dd00ce00d88c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.083653 Aug 31 05:20:50.838203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 144/296] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:50 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:51.075984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:51.076668 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:51.084226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:51.084749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:51.085212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:51.085943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:51.086463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:51.086916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:51.219347 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:51.227357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6f924a44-27ae-436c-9803-244dbc318303 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.155777 Aug 31 05:20:51.227922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 153/297] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:51 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:51.259332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:51.259926 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:51.266352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:51.266843 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:51.267264 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:51.267945 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:51.268386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:51.268797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:51.330660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:51.338388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b682e84f-ed07-4f5a-b7cc-ae42fcebbfe9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.083023 Aug 31 05:20:51.339076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 145/298] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:51 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:51.857938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:51.858696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:51.865192 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:51.865668 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:51.866140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:51.866811 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:51.867251 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:51.867831 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:51.928289 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:51.936102 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6b9dd4bf-be28-4edc-8f9e-b4c649f80c10 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.082001 Aug 31 05:20:51.936683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 154/299] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:51 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:52.256418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:52.257496 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:52.265240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:52.265827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:52.266165 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:52.266838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:52.267278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:52.267691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:52.359669 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:52.360265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:52.366797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:52.367273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:52.367700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:52.368345 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:52.368785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:52.369205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:52.417973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:52.420266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=4 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:52.427094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-aa136ad0-53f4-4218-a06f-d864ff6e6bb7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.177282 Aug 31 05:20:52.427735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 146/300] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:52 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:52.433737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:52.442184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4dfe9d61-6661-4ef3-abee-64b2e0b40ccb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.086658 Aug 31 05:20:52.442749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 155/301] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:52 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:52.956452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:52.957043 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:52.959235 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:52.963897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:52.964367 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:52.964758 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:52.965429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:52.965902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:52.966339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:53.032095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:53.039974 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-16995b4a-9b96-45ea-851f-7968419098de tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.087314 Aug 31 05:20:53.040449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 147/302] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:52 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:53.451618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:53.452782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:53.455772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:53.457651 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=14 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:53.458839 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:53.465607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:53.466236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:53.467695 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:53.468180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:53.468607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:53.469299 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:53.469740 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:53.470182 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:53.472242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:53.472713 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:53.473131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:53.473800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:53.474371 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:53.474659 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:53.534784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=18 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:53.559845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:53.567815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a0aa0437-ac18-4ca7-a860-05c027b628ed tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.107665 Aug 31 05:20:53.568422 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 148/303] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:53 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:53.631404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:53.640600 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b0fe34b3-7dd9-4932-ab53-315794175173 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.195457 Aug 31 05:20:53.641501 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 156/304] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:53 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:54.062474 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:54.063094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:54.069639 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:54.070122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:54.070554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:54.071244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:54.071703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:54.072122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:54.133852 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:54.142037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e01ffecf-3a16-4424-ab3c-1fd004af73b2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.083712 Aug 31 05:20:54.142689 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 149/305] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:54 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:54.593040 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:54.594317 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:54.605016 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:54.605486 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:54.605902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:54.606618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:54.607052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:54.607457 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:54.660995 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:54.661534 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:54.667913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:54.668386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:54.668802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:54.669468 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:54.669909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:54.670349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:54.675632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:54.683698 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a442d137-a0be-4ae7-8674-f0b65134ac5d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.097892 Aug 31 05:20:54.684492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 157/306] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:54 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:54.806499 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:54.815031 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bc570774-209f-4c1d-8ef7-cd0c3822b34c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.157927 Aug 31 05:20:54.815609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 150/307] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:54 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:55.167263 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:55.167944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:55.175543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:55.176125 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:55.176642 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:55.177467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:55.178039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:55.178547 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:55.242942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:55.250930 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-33e6abc3-4c11-4a48-8fc9-024b25ea5796 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.090354 Aug 31 05:20:55.251502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 158/308] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:55 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:55.708042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:55.708998 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:55.717202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:55.717682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:55.718156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:55.718837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:55.719280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:55.719690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:55.780637 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:55.788922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e58b0fb8-b13b-4f07-b759-8c1519c7a37f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.087085 Aug 31 05:20:55.789484 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 151/309] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:55 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:55.836412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:55.837010 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:55.845782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:55.846377 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:55.846995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:55.847517 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:55.847953 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:55.848360 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:55.992403 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:56.000201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1e54a317-98d9-4e0d-90b2-39286031fb86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.167652 Aug 31 05:20:56.000760 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 159/310] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:55 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:56.275371 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:56.276471 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:56.283727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:56.284290 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:56.284787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:56.285579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:56.286144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:56.286640 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:56.351717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:56.359923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-83b050d9-5102-423a-9668-b2c368b4be88 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.090956 Aug 31 05:20:56.360508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 152/311] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:56 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:56.813706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:56.814807 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:56.824321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:56.824792 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:56.825221 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:56.825888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:56.826362 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:56.826797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:56.888846 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:56.897181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4b772e11-d6ba-4c60-b228-8ee19f7aa2dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.089942 Aug 31 05:20:56.897759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 160/312] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:56 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:57.024714 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:57.025734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:57.032357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:57.032839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:57.033261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:57.033940 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:57.034419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:57.034819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:57.166224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:57.173897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dd6907d4-46bc-4516-98d2-0f0559003507 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.155865 Aug 31 05:20:57.174457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 153/313] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:57 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:57.383699 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:57.384288 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:57.390779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:57.391241 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:57.391662 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:57.392339 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:57.392778 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:57.393190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:57.456354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:57.464055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0a4268ad-0b61-4c53-a14e-01e18f8049eb tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.084335 Aug 31 05:20:57.464614 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 161/314] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:57 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:57.921561 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:57.922540 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:57.932527 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:57.933042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:57.933463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:57.934173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:57.934614 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:57.935027 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:57.996283 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:58.004451 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f8055e3e-652d-4ece-92a8-6506bb93a4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.089323 Aug 31 05:20:58.005006 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 154/315] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:57 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:58.194541 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:58.195134 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:58.201543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:58.202038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:58.202474 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:58.203150 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:58.203584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:58.203993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:58.341208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:58.349423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f86a2cea-5156-4445-802a-2cd64a6b91f9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.158681 Aug 31 05:20:58.349989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 162/316] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:58 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:58.484554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:58.485122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:58.491208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:58.491677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:58.492095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:58.492788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:58.493229 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:58.493634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:58.555011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:58.563934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-504df220-8a99-4687-8c0d-d2494210a021 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.083696 Aug 31 05:20:58.564499 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 155/317] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:58 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:59.032323 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:59.032887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:59.039420 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:59.039853 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:59.040306 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:59.041104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:59.041822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:59.042222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:59.046621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:59.113959 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:59.122115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1566fbab-27a9-4f9e-9a86-81f69a407468 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.093586 Aug 31 05:20:59.122673 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 163/318] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:59 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:20:59.372956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:59.373580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:59.380150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:59.380675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:59.381123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:59.381823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:59.382327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:59.382762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:59.512022 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:59.520143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-634b3737-46f0-474b-8f00-2a6fd21099d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.152160 Aug 31 05:20:59.520769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 156/319] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:59 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:20:59.585229 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:20:59.585787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:20:59.592510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:59.592976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:59.593392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:59.594037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:20:59.594508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:20:59.594910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:20:59.659450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:20:59.667490 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9a4de720-d35f-45d3-bd40-8e739bd8e22b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.086595 Aug 31 05:20:59.668057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 164/320] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:20:59 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:00.147111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:00.148139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:00.155609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:00.156092 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:00.156516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:00.157191 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:00.157633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:00.158048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:00.222022 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:00.229876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f04013ed-47b0-4351-b7ac-b4c848a778b7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.089108 Aug 31 05:21:00.230474 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 157/321] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:00 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:00.544239 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:00.544944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:00.553395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:00.554056 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:00.554636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:00.555532 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:00.556126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:00.556675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:00.687542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:00.688272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:00.693465 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:00.694404 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:00.694882 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:00.695304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:00.696173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:00.696601 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:00.697014 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:00.701143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:00.701265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9abd46a5-cebe-45a1-87eb-0970c81bdb05 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.163329 Aug 31 05:21:00.702295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 165/322] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:00 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:00.757313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:00.765030 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-697ba7d1-ccc5-47f2-b4ac-30c49236ebba tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.081666 Aug 31 05:21:00.765597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 158/323] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:00 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:01.255050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:01.256030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:01.264050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:01.264522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:01.264935 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:01.265606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:01.266036 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:01.266441 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:01.326759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:01.334630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e4095f18-5f68-4a54-a2e9-77e93f993b79 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.086090 Aug 31 05:21:01.335240 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 166/324] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:01 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:01.726050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:01.727052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:01.737498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:01.738377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:01.739083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:01.740221 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:01.740962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:01.741652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:01.784984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:01.785699 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:01.792714 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:01.793275 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:01.793769 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:01.794561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:01.795071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:01.795549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:01.865719 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:01.873789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-681fd966-924b-4dab-b408-1381d13ca942 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.092766 Aug 31 05:21:01.874371 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 167/325] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:01 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:01.906910 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:01.915360 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eb5ee39b-ee15-4b37-a5f0-6ce5699f5e35 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.195764 Aug 31 05:21:01.915929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 159/326] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:01 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:02.354894 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:02.355541 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:02.362387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:02.362869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:02.363309 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:02.364256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:02.364703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:02.365101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:02.428226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:02.437927 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3cce5db4-fbd5-4a9c-8efc-bf6ca3103168 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.086877 Aug 31 05:21:02.438570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 168/327] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:02 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:02.899896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:02.900568 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:02.909583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:02.910215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:02.910801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:02.911805 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:02.912425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:02.912977 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:02.942555 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:02.943214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:02.949831 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:02.950326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:02.950744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:02.951415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:02.951848 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:02.952254 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:02.976576 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:02.984978 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-64c1ccd6-5024-4938-bbe4-cd8180bada43 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.091234 Aug 31 05:21:02.985777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 160/328] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:02 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:03.081919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:03.089740 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8b6f51e6-5b9b-4288-9efd-9315b66245bf tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.150995 Aug 31 05:21:03.090341 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 169/329] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:02 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:03.461073 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:03.461661 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:03.468079 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:03.468550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:03.468977 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:03.469643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:03.470109 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:03.470520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:03.530700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:03.538308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9f333a4b-5ba9-40c4-b169-118150410e67 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.081159 Aug 31 05:21:03.539156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 161/330] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:03 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:04.010055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:04.011043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:04.021742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:04.022606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:04.023294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:04.024750 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:04.025621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:04.026318 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:04.093588 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:04.101435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1d46c627-5bd5-4d77-917a-e4258c9b015f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.099063 Aug 31 05:21:04.102030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 170/331] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:04 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:04.110415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:04.111056 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:04.117166 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:04.117662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:04.118060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:04.118756 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:04.119200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:04.119613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:04.252471 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:04.260847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1ccf251d-a775-4cb1-883b-112998804b48 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.154497 Aug 31 05:21:04.261321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 162/332] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:04 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:04.559227 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:04.559739 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:04.565990 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:04.566502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:04.566932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:04.567618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:04.568036 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:04.568446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:04.628789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:04.636786 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fadb4bf8-4c9d-4c4b-bbb7-66e3774d6f51 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.081564 Aug 31 05:21:04.637326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 171/333] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:04 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:05.126325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:05.127188 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:05.136758 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:05.137227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:05.137646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:05.138348 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:05.138780 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:05.139184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:05.201435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:05.209698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c29f2269-bd1f-4d3c-a621-9764903544af tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1194 microversion: 2.1 time: 0.089969 Aug 31 05:21:05.210308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 163/334] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:05 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:05.283226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:05.284003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:05.292300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:05.292893 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:05.293415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:05.294279 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:05.294825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:05.295343 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:05.439048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:05.449346 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d3f5645d-2fc4-4265-b90f-12abaf03603d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.170956 Aug 31 05:21:05.450154 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 172/335] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:05 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:05.658684 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:05.659277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:05.665700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:05.666205 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:05.666671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:05.667341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:05.667759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:05.668183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:05.729176 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:05.738781 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d417f2b1-087b-4f99-bc62-2f36a3a21b83 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1273 microversion: 2.1 time: 0.083652 Aug 31 05:21:05.739165 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 164/336] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:05 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:06.114140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-cd7bfafa-d1f1-4ba6-98ff-952a00802581 req-03ccf1f0-274f-4cc3-b4ca-24a9e18e9bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba", "name": "network-vif-plugged", "status": "completed", "tag": "11a1013b-8b7b-45e4-805e-4472b37e2449"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:06.124095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-cd7bfafa-d1f1-4ba6-98ff-952a00802581 req-03ccf1f0-274f-4cc3-b4ca-24a9e18e9bb3 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:06.124631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-cd7bfafa-d1f1-4ba6-98ff-952a00802581 req-03ccf1f0-274f-4cc3-b4ca-24a9e18e9bb3 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:06.125104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-cd7bfafa-d1f1-4ba6-98ff-952a00802581 req-03ccf1f0-274f-4cc3-b4ca-24a9e18e9bb3 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:06.138945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-cd7bfafa-d1f1-4ba6-98ff-952a00802581 req-03ccf1f0-274f-4cc3-b4ca-24a9e18e9bb3 service nova] Creating event network-vif-plugged:11a1013b-8b7b-45e4-805e-4472b37e2449 for instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba on hv-cinder-85220 Aug 31 05:21:06.144066 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-cd7bfafa-d1f1-4ba6-98ff-952a00802581 req-03ccf1f0-274f-4cc3-b4ca-24a9e18e9bb3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Aug 31 05:21:06.144651 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 173/337] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:06.236922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:06.238105 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:06.244752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:06.245229 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:06.245763 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:06.246599 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:06.247078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:06.247567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:06.320557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:06.329041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c542aa82-1af5-49ce-b55c-2dcd97c1cc25 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1204 microversion: 2.1 time: 0.096054 Aug 31 05:21:06.330346 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 165/338] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:06 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:06.474959 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:06.475633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:06.499188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:06.499668 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:06.511482 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:06.512250 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:06.512724 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:06.513135 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:06.760845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:06.761943 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:06.768907 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:06.769903 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:06.770826 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:06.772780 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:06.773473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:06.774153 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:06.774438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:06.788654 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-292a34c5-11c2-42d8-8fb6-d0c762bbdcea tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.317630 Aug 31 05:21:06.790375 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 174/339] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:06 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:06.852802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:06.861941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-db5de04e-e774-4da2-be1c-d75d0b9449e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1281 microversion: 2.1 time: 0.104943 Aug 31 05:21:06.862561 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 166/340] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:06 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:07.349732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:07.350348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:07.359373 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:07.359849 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:07.360484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:07.361161 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:07.362942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:07.363367 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:07.523462 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:07.533461 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-611d1523-f90e-42e9-83d5-e277bc14ca11 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1272 microversion: 2.1 time: 0.187500 Aug 31 05:21:07.546955 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 175/341] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:07 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:07.811749 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:07.812662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:07.836692 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:07.837196 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:07.837666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:07.838532 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:07.839008 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:07.839451 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:07.884787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:07.886081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:07.897104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:07.898128 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:07.898990 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:07.900407 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:07.900941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:07.901592 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:08.452005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:08.460081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7cebe077-1382-4e7e-961e-119a05f6bc86 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1314 microversion: 2.1 time: 0.654638 Aug 31 05:21:08.460657 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 167/342] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:07 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:08.496422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:08.505566 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-343da4b6-8027-4291-a134-10c4db61eb96 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.625708 Aug 31 05:21:08.506443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 176/343] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:07 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:08.555774 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:08.556376 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:08.564055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:08.564544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:08.564969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:08.565653 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:08.566289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:08.567129 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:08.755718 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:08.765869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6ca7f778-4d91-4575-9167-4697268949ff tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1272 microversion: 2.1 time: 0.213706 Aug 31 05:21:08.766921 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 168/344] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:08 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:09.176493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-8bf5f5d7-8cca-4b79-8128-22d4dbac6133 req-0f2e299f-9310-4126-9d05-1d085b03b1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84115827-b1df-419c-b693-8b9105afcbbd", "tag": "3a5ee679-8365-4a8d-a3d4-4874a75745af"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:09.209988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-8bf5f5d7-8cca-4b79-8128-22d4dbac6133 req-0f2e299f-9310-4126-9d05-1d085b03b1d0 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:09.212799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-8bf5f5d7-8cca-4b79-8128-22d4dbac6133 req-0f2e299f-9310-4126-9d05-1d085b03b1d0 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:09.213715 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-8bf5f5d7-8cca-4b79-8128-22d4dbac6133 req-0f2e299f-9310-4126-9d05-1d085b03b1d0 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:09.240279 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-8bf5f5d7-8cca-4b79-8128-22d4dbac6133 req-0f2e299f-9310-4126-9d05-1d085b03b1d0 service nova] Creating event network-changed:3a5ee679-8365-4a8d-a3d4-4874a75745af for instance 84115827-b1df-419c-b693-8b9105afcbbd on hv-cinder-85220 Aug 31 05:21:09.247619 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-8bf5f5d7-8cca-4b79-8128-22d4dbac6133 req-0f2e299f-9310-4126-9d05-1d085b03b1d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076296 Aug 31 05:21:09.248560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 177/345] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:09.344866 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-65960ade-d8dc-4c89-bc8a-27ad0c1991bc req-7734585d-70f5-4056-8699-3706a47ececf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b72dc747-3be8-4092-b09d-1d6943280b33", "tag": "23757f50-f4a3-4633-bbf5-0bb3ca5b5075"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:09.355202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-65960ade-d8dc-4c89-bc8a-27ad0c1991bc req-7734585d-70f5-4056-8699-3706a47ececf service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:09.355897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-65960ade-d8dc-4c89-bc8a-27ad0c1991bc req-7734585d-70f5-4056-8699-3706a47ececf service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:09.356411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-65960ade-d8dc-4c89-bc8a-27ad0c1991bc req-7734585d-70f5-4056-8699-3706a47ececf service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:09.372203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-65960ade-d8dc-4c89-bc8a-27ad0c1991bc req-7734585d-70f5-4056-8699-3706a47ececf service nova] Creating event network-changed:23757f50-f4a3-4633-bbf5-0bb3ca5b5075 for instance b72dc747-3be8-4092-b09d-1d6943280b33 on hv-cinder-85220 Aug 31 05:21:09.377670 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-65960ade-d8dc-4c89-bc8a-27ad0c1991bc req-7734585d-70f5-4056-8699-3706a47ececf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036966 Aug 31 05:21:09.378311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 169/346] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:09.484216 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:09.484932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:09.492314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:09.492863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:09.493356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:09.494169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:09.494689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:09.495163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:09.529823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:09.530790 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:09.543614 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:09.544156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:09.544584 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:09.545275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:09.545720 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:09.546183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:09.748316 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:09.751755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:09.756686 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-89c37ba1-96c7-433e-b67d-00d8ef8955cc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1498 microversion: 2.1 time: 0.278207 Aug 31 05:21:09.757482 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 178/347] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:09 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:09.760385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8261d1a5-f550-4df3-95fe-f646f05e80e6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.235085 Aug 31 05:21:09.761017 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 170/348] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:09 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:09.786469 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:09.787136 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:09.795163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:09.795869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:09.796517 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:09.798042 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:09.798042 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:09.798042 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:10.188023 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:10.198097 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-df171727-3dfc-455e-9e3c-3d7dcf235d2f tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.415373 Aug 31 05:21:10.198679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 179/349] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:09 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:10.665848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:10.666433 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:10.673746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:10.674245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:10.678137 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:10.680648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:10.683375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:10.684072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:10.713270 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:21:10.780869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:10.781472 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:10.788357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:10.788841 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:10.789272 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:10.789949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:10.790423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:10.790837 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:10.814280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-08867f7a-8f0a-49e9-add0-71e63093a8dc tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 204 len: 0 microversion: 2.1 time: 0.153695 Aug 31 05:21:10.815211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 171/350] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:21:10 2022] DELETE /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:21:10.823582 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:10.824261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:10.830850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:10.831323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:10.831742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:10.832427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:10.832855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:10.833254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:10.967917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:10.977812 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-033d068a-b914-4d41-bb26-fef9e1dadc5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.200939 Aug 31 05:21:10.978791 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 180/351] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:10 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:10.998769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:11.006544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1e6438ce-1f4d-4bc0-aa34-fe5dcee5c2c1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.187091 Aug 31 05:21:11.007098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 172/352] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:10 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:11.219284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:11.219814 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:11.226036 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:11.226511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:11.226927 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:11.227667 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:11.228100 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:11.228502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:11.232463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:11.271776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-8d7ba4ad-a42b-403f-8463-73a5d85887c0 req-0bf281f7-fce1-43dc-a332-45c06c9720c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed7b172-674e-4db9-ab55-7dccf7d89ec9", "tag": "773bd3ad-05e1-4670-8cb8-c61eac5e26e9"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:11.281696 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8d7ba4ad-a42b-403f-8463-73a5d85887c0 req-0bf281f7-fce1-43dc-a332-45c06c9720c6 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:11.282272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8d7ba4ad-a42b-403f-8463-73a5d85887c0 req-0bf281f7-fce1-43dc-a332-45c06c9720c6 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:11.282757 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8d7ba4ad-a42b-403f-8463-73a5d85887c0 req-0bf281f7-fce1-43dc-a332-45c06c9720c6 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:11.297794 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-8d7ba4ad-a42b-403f-8463-73a5d85887c0 req-0bf281f7-fce1-43dc-a332-45c06c9720c6 service nova] Creating event network-changed:773bd3ad-05e1-4670-8cb8-c61eac5e26e9 for instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 on hv-cinder-85220 Aug 31 05:21:11.302889 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-8d7ba4ad-a42b-403f-8463-73a5d85887c0 req-0bf281f7-fce1-43dc-a332-45c06c9720c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034734 Aug 31 05:21:11.303471 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 173/353] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:21:11.372391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:11.384000 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e1e6a839-9d51-4ef6-b366-b9cf47f8b142 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.168344 Aug 31 05:21:11.384830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 181/354] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:11 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:12.001587 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:12.002293 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:12.010335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:12.010914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:12.011439 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:12.012264 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:12.012812 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:12.013451 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:12.027632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:12.028214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:12.034699 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:12.035165 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:12.035586 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:12.036013 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:12.036253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:12.036692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:12.037095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:12.164559 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:12.172909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a287a76b-cedc-4b64-8ea4-f3339e30288f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.176568 Aug 31 05:21:12.173465 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 174/355] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:11 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:12.304769 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:12.312942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4bcee6e4-2abb-4cbd-88a4-417247b49f83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.289798 Aug 31 05:21:12.313508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 182/356] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:12 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:12.413243 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:12.413973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:12.421097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:12.421576 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:12.422555 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:12.422662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:12.423159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:12.423570 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:12.553628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:12.561903 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-933c3dcf-94f0-4a15-99d0-89e6075e93e5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.154474 Aug 31 05:21:12.562502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 175/357] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:12 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:13.198169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:13.198746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:13.207584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:13.208428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:13.209131 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:13.209984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:13.210571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:13.211081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:13.333162 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:13.333758 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:13.340174 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:13.340619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:13.341066 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:13.341731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:13.342203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:13.342617 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:13.346677 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:13.360859 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-936e33d6-4441-45ca-aa4d-c540617a2205 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.169233 Aug 31 05:21:13.362162 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 183/358] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:13 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:13.476417 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:13.484535 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-04b371ff-82a8-41ba-8eba-14e1a7540e70 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.155231 Aug 31 05:21:13.485094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 176/359] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:13 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:13.586835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:13.587854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:13.595197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:13.595724 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:13.596187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:13.596934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:13.597424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:13.597880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:13.729545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:13.737696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9c6fd740-895b-457a-9d38-ad8f08cec914 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.157292 Aug 31 05:21:13.738297 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 184/360] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:13 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:14.385958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:14.386902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:14.397262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:14.398075 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:14.398810 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:14.399920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:14.400746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:14.401161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:14.505343 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:14.506454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:14.515620 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:14.516230 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:14.516866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:14.517894 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:14.518618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:14.519233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:14.543937 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:14.551747 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d8a910ce-a36e-4e41-8c36-b4f72f9664df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.172116 Aug 31 05:21:14.552278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 177/361] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:14 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:14.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:14.673492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-10b1fefc-4942-44d8-ad1b-0d693af641d1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.172504 Aug 31 05:21:14.674049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 185/362] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:14 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:14.758379 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:14.758911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:14.765017 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:14.765520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:14.765948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:14.766653 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:14.767096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:14.767505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:14.905186 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:14.913243 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d506db86-41db-4523-b5f8-dbb83ddcd1ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.158875 Aug 31 05:21:14.913806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 178/363] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:14 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:15.575965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:15.576675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:15.585714 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:15.586395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:15.586962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:15.587852 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:15.588440 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:15.588990 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:15.694462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:15.695066 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:15.701192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:15.701661 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:15.702105 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:15.702748 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:15.703220 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:15.703626 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:15.731543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:15.740052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c9007d2b-75e5-4760-8ba4-6656d2d8bf98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.169922 Aug 31 05:21:15.740625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 186/364] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:15 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:15.833093 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:15.841425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-da5041d0-fb44-4314-ba53-6dfffb79aef9 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.150906 Aug 31 05:21:15.841988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 179/365] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:15 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:15.937800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:15.938802 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:15.948703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:15.949488 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:15.950248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:15.951354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:15.952080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:15.952760 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:16.097947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:16.106319 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-53c5a118-d0d0-47af-a8e8-32e383b54ef5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.174922 Aug 31 05:21:16.106888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 187/366] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:15 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:16.760891 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:16.761570 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:16.767827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:16.768314 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:16.768703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:16.769375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:16.769808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:16.770439 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:16.862509 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:16.863236 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:16.869960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:16.870537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:16.870953 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:16.871624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:16.872060 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:16.872463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:16.903352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:16.911301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ffb8c69e-f917-47e4-bdf0-1859e8c3f845 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.154699 Aug 31 05:21:16.911869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 180/367] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:16 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:17.002346 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:17.010826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4da4ee38-8bf1-4554-9f90-502c026f2e97 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.152523 Aug 31 05:21:17.011373 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 188/368] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:16 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:17.127158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:17.127681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:17.133935 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:17.134477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:17.134958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:17.135663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:17.136131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:17.136543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:17.275348 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:17.283514 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-26c5b7bf-fa82-4f47-aa16-d438d0bb924a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.160282 Aug 31 05:21:17.284074 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 181/369] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:17 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:17.935641 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:17.936623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:17.947046 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:17.947730 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:17.948144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:17.948800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:17.949279 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:17.949652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:18.032135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:18.032728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:18.039114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:18.039583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:18.039967 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:18.040955 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:18.041576 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:18.042177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:18.101361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:18.109920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f6f9d033-2aca-4da0-85b2-4fe71971e323 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.180595 Aug 31 05:21:18.110907 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 189/370] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:17 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:18.304404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:18.305001 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:18.311932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:18.312467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:18.312888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:18.313570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:18.314015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:18.314436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:18.433329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:18.441862 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4b78ded8-eb5d-454d-ba74-d6afd5c1b73a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.413684 Aug 31 05:21:18.442563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 182/371] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:18 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:18.502557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:18.511976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b9130828-e1b6-4bb6-b9d8-51c8d42fa904 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.211836 Aug 31 05:21:18.512580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 190/372] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:18 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:19.131569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:19.132193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:19.139081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:19.139684 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:19.140102 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:19.140777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:19.141217 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:19.141622 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:19.279666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:19.287853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-35ec3a6b-4c2d-4b7a-8c7e-e89bebb4bfc7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.160076 Aug 31 05:21:19.299098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 183/373] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:19 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:19.463581 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:19.464225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:19.471048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:19.471557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:19.472020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:19.472700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:19.473326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:19.473752 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:19.534391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:19.535415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:19.541948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:19.542481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:19.542903 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:19.543611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:19.544255 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:19.544712 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:19.670314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:19.677050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f244bf39-8d73-4b7b-8283-b164e0f0fbdd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.217488 Aug 31 05:21:19.686970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 191/374] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:19 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:19.741549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:19.750121 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9064d028-371b-4e6c-a7b9-4a4ea78cfed6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.219501 Aug 31 05:21:19.750704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 184/375] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:19 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:20.107527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-85edfc53-2bf0-4214-90f7-832ce3cabd51 req-348c3e69-edda-490c-b3e3-90f3bccd4bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed7b172-674e-4db9-ab55-7dccf7d89ec9", "name": "network-vif-plugged", "status": "completed", "tag": "773bd3ad-05e1-4670-8cb8-c61eac5e26e9"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:20.125676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-85edfc53-2bf0-4214-90f7-832ce3cabd51 req-348c3e69-edda-490c-b3e3-90f3bccd4bb7 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:20.129594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-85edfc53-2bf0-4214-90f7-832ce3cabd51 req-348c3e69-edda-490c-b3e3-90f3bccd4bb7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:20.130157 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-85edfc53-2bf0-4214-90f7-832ce3cabd51 req-348c3e69-edda-490c-b3e3-90f3bccd4bb7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:20.156741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-85edfc53-2bf0-4214-90f7-832ce3cabd51 req-348c3e69-edda-490c-b3e3-90f3bccd4bb7 service nova] Creating event network-vif-plugged:773bd3ad-05e1-4670-8cb8-c61eac5e26e9 for instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 on hv-cinder-85220 Aug 31 05:21:20.168449 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-85edfc53-2bf0-4214-90f7-832ce3cabd51 req-348c3e69-edda-490c-b3e3-90f3bccd4bb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064573 Aug 31 05:21:20.172395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 192/376] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:20.308910 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:20.309502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:20.315837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:20.316309 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:20.316729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:20.317404 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:20.317841 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:20.318287 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:20.543267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:20.551043 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-53c2514a-3b67-4f6a-8e7c-44ac25a0fd0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.246208 Aug 31 05:21:20.551612 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 185/377] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:20 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:20.701821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:20.702621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:20.710320 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:20.710756 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:20.711161 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:20.711840 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:20.712278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:20.712686 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:20.771149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:20.771852 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:20.778387 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:20.778941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:20.779607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:20.780347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:20.781033 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:20.781505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:20.913611 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:20.921957 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-99cc52e6-f8fb-4bd1-819c-aae18c34759f tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.224567 Aug 31 05:21:20.922564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 193/378] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:20 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:20.958180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:20.966100 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-edc32ad4-a0c7-4cef-b6ee-545b82c53afd tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.198719 Aug 31 05:21:20.966670 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 186/379] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:20 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:21.571448 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:21.572109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:21.578183 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:21.578716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:21.579762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:21.580448 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:21.580914 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:21.581345 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:21.717107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:21.725277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9df9607c-7403-4855-abfd-e7fb36210c30 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.157742 Aug 31 05:21:21.725922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 194/380] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:21 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:21.944906 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:21.945625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:21.951665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:21.952142 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:21.952561 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:21.953276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:21.953693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:21.954141 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:21.989523 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:21.991360 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:21.998540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:21.999576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:22.000219 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:22.001137 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:22.001900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:22.002593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:22.216870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:22.226993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d569e564-545a-4f21-b8ff-4717fcc0ad2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.285864 Aug 31 05:21:22.244902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 187/381] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:21 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:22.257807 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:22.267012 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6dd200ee-55d3-47cc-9ced-5acafe7a3b85 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.283304 Aug 31 05:21:22.277587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 195/382] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:21 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:22.747853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:22.748878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:22.758833 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:22.759506 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:22.759938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:22.760632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:22.761082 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:22.761504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:22.892430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:22.900231 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e64db588-2eea-42f8-8d87-23df955ceb78 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.157135 Aug 31 05:21:22.900804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 188/383] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:22 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:23.257445 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:23.258799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:23.266880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:23.271418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:23.272677 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:23.273941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:23.274743 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:23.276269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:23.288739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:23.289399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:23.291219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:23.297702 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:23.298219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:23.305603 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:23.305947 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:23.306570 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:23.306978 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:23.536009 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:23.548749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cf456858-27db-4bc2-86a9-8e54a1e6bd87 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1504 microversion: 2.1 time: 0.296145 Aug 31 05:21:23.559841 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 196/384] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:23 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:23.560024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:23.573950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b285c98a-ccc6-453f-9019-b170783ad4d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.288605 Aug 31 05:21:23.574576 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 189/385] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:23 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:23.920635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:23.921251 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:23.926387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=82 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:23.928113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:23.928754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:23.929353 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:23.930238 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:23.930995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:23.931583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:24.121975 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-dbdfc14c-0b21-4629-8af3-ca9ed63ee798 req-ceb499d7-226a-41bc-afaa-ec73e3c11efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba", "name": "network-vif-unplugged", "status": "completed", "tag": "11a1013b-8b7b-45e4-805e-4472b37e2449"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:24.148294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-dbdfc14c-0b21-4629-8af3-ca9ed63ee798 req-ceb499d7-226a-41bc-afaa-ec73e3c11efe service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:24.149039 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-dbdfc14c-0b21-4629-8af3-ca9ed63ee798 req-ceb499d7-226a-41bc-afaa-ec73e3c11efe service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:24.149691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-dbdfc14c-0b21-4629-8af3-ca9ed63ee798 req-ceb499d7-226a-41bc-afaa-ec73e3c11efe service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:24.163026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-dbdfc14c-0b21-4629-8af3-ca9ed63ee798 req-ceb499d7-226a-41bc-afaa-ec73e3c11efe service nova] Creating event network-vif-unplugged:11a1013b-8b7b-45e4-805e-4472b37e2449 for instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba on hv-cinder-85220 Aug 31 05:21:24.169387 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-dbdfc14c-0b21-4629-8af3-ca9ed63ee798 req-ceb499d7-226a-41bc-afaa-ec73e3c11efe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054216 Aug 31 05:21:24.170762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 190/386] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:24.231395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:24.239954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5f99ff6c-f5ef-42eb-9bf5-54b88318a682 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.323047 Aug 31 05:21:24.240495 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 197/387] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:23 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:24.479478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-c79cb344-3cdb-47a4-a568-06e1203b62df req-361ec7be-69a5-4fcf-89ba-d4eff4d196c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba", "name": "network-vif-deleted", "tag": "11a1013b-8b7b-45e4-805e-4472b37e2449"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:24.489595 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-c79cb344-3cdb-47a4-a568-06e1203b62df req-361ec7be-69a5-4fcf-89ba-d4eff4d196c5 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:24.490437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-c79cb344-3cdb-47a4-a568-06e1203b62df req-361ec7be-69a5-4fcf-89ba-d4eff4d196c5 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:24.490658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-c79cb344-3cdb-47a4-a568-06e1203b62df req-361ec7be-69a5-4fcf-89ba-d4eff4d196c5 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:24.501820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-c79cb344-3cdb-47a4-a568-06e1203b62df req-361ec7be-69a5-4fcf-89ba-d4eff4d196c5 service nova] Creating event network-vif-deleted:11a1013b-8b7b-45e4-805e-4472b37e2449 for instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba on hv-cinder-85220 Aug 31 05:21:24.506840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-c79cb344-3cdb-47a4-a568-06e1203b62df req-361ec7be-69a5-4fcf-89ba-d4eff4d196c5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Aug 31 05:21:24.507428 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 191/388] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:24.571890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:24.572540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:24.579159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:24.579637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:24.580066 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:24.580759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:24.581210 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:24.581696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:24.595968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:24.596748 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:24.602909 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:24.603718 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:24.604324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:24.604840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:24.605592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:24.606197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:24.606663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:24.627080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:24.653650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:24.662922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-63faa246-02da-4963-bf91-67dc30490d2d tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1462 microversion: 2.1 time: 0.096474 Aug 31 05:21:24.663491 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 198/389] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:24 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:24.754040 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:24.762369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-520e6929-0345-4416-9d2b-87ab6d0c6dd1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.170966 Aug 31 05:21:24.762934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 192/390] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:24 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:25.260979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:25.261553 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:25.268049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:25.268706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:25.269478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:25.270433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:25.270874 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:25.271285 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:25.407806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:25.415950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-eb084965-44c1-4904-bd5f-d070fafd1fb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1321 microversion: 2.1 time: 0.159005 Aug 31 05:21:25.416599 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 199/391] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:25 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:25.683783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:25.684446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:25.690657 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:25.691419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:25.692032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:25.692774 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:25.693339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:25.693815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:25.728512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:25.729085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:25.729716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:25.730368 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lazy-loading 'fault' on Instance uuid e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:21:25.783375 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:25.783977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:25.791620 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:25.792263 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:25.795223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:25.795786 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:25.796719 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:25.797429 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:25.797940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:25.802696 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-73196e60-4a1d-4ea2-b802-7ccc0ea739f5 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1304 microversion: 2.1 time: 0.122806 Aug 31 05:21:25.804320 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 193/392] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:25 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:26.009475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:26.021959 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1d512d70-dc43-45fc-bc09-95da6abd9596 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.241777 Aug 31 05:21:26.023355 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 200/393] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:25 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:26.436310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:26.436906 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:26.443523 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.443991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.444411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.445075 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.445558 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.445961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.581592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:26.589467 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7c0c29f5-b51c-4e45-b21a-2eda905b97e3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1515 microversion: 2.1 time: 0.157157 Aug 31 05:21:26.590053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 194/394] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:26 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:26.610639 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:26.612970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:26.619048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.619645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.619924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.620592 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.621029 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.621433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.646905 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lazy-loading 'flavor' on Instance uuid 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:21:26.775949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ffd27807-21ed-47f1-972c-b4e853816e43 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9/action" status: 200 len: 32 microversion: 2.1 time: 0.168598 Aug 31 05:21:26.781422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 201/395] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:21:26 2022] POST /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:21:26.787257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:26.797304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:26.812048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.812780 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.813449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.814575 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.815179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.815651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.831922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:26.832837 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:26.843494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.845545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.846638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.848130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.848593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.849056 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.897707 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:26.898295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:26.898839 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:26.902150 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lazy-loading 'fault' on Instance uuid e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:21:27.020308 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:27.028313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1dca405a-fe09-4b29-97c1-8f267f3015bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 200 len: 1304 microversion: 2.1 time: 0.206981 Aug 31 05:21:27.029214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 202/396] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:26 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:27.049197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:27.049830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:27.057512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:27.058103 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:27.058587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:27.059330 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:27.059822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:27.060354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:27.260590 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:27.275195 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ecdb7d62-d72f-4906-9834-72b057a13305 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.486496 Aug 31 05:21:27.278227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 195/397] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:26 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:27.346114 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:27.355198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e16b63e5-6b05-44f8-921a-6d6bd77d1ffc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.315614 Aug 31 05:21:27.356005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 203/398] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:27 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:28.057533 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:28.058140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:28.064891 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:28.065373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:28.065801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:28.066547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:28.066990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:28.067395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:28.163025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-5a7cb231-b24a-4959-a1aa-b0fe22f36527 req-03d16859-ad23-4f4d-adeb-a21bc5892777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b72dc747-3be8-4092-b09d-1d6943280b33", "name": "network-vif-plugged", "status": "completed", "tag": "23757f50-f4a3-4633-bbf5-0bb3ca5b5075"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:28.179020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5a7cb231-b24a-4959-a1aa-b0fe22f36527 req-03d16859-ad23-4f4d-adeb-a21bc5892777 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:28.179698 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5a7cb231-b24a-4959-a1aa-b0fe22f36527 req-03d16859-ad23-4f4d-adeb-a21bc5892777 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:28.180547 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5a7cb231-b24a-4959-a1aa-b0fe22f36527 req-03d16859-ad23-4f4d-adeb-a21bc5892777 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:28.195112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-5a7cb231-b24a-4959-a1aa-b0fe22f36527 req-03d16859-ad23-4f4d-adeb-a21bc5892777 service nova] Creating event network-vif-plugged:23757f50-f4a3-4633-bbf5-0bb3ca5b5075 for instance b72dc747-3be8-4092-b09d-1d6943280b33 on hv-cinder-85220 Aug 31 05:21:28.201755 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-5a7cb231-b24a-4959-a1aa-b0fe22f36527 req-03d16859-ad23-4f4d-adeb-a21bc5892777 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043328 Aug 31 05:21:28.203218 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 204/399] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:21:28.233911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] HTTP exception thrown: Instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba could not be found. Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Request method failure captured: Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba HTTP/1.1 Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu-ZQgMr8KWkfma4a8SG5AYN15T6y0A6cPOGYT6EP2EvZ5-Ba67NkfEFt3htmzKY2H5Hn9Coh2jLT6Vtz9d8cP_b0FURLCCyGXgg2C1FDedpaFQCeDQQ9b6RprAcEXjwYQM3MB-uJ3PwkL1Xk3cUJkhCXmaX7gnnuAelwvv5KpZluq0 Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 04da0465aa794d208d6dd9e2aab7d704 Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesActionsTest-739832668 Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:21:28.235574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04da0465aa794d208d6dd9e2aab7d704"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_04da0465aa794d208d6dd9e2aab7d704", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04da0465aa794d208d6dd9e2aab7d704"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/04da0465aa794d208d6dd9e2aab7d704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesActionsTest-739832668 Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 04da0465aa794d208d6dd9e2aab7d704 Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesActionsTest-739832668 Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesActionsTest-739832668-project Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 9d7f48e1763e4ff3b77ddb90e65045b0 Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesActionsTest-739832668-project Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba could not be found. Aug 31 05:21:28.237301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba'} Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba could not be found. Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:21:28.238275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba could not be found. Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba could not be found. Aug 31 05:21:28.239808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:28.241324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Returning 404 to user: Instance e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:21:28.241324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9b474293-fdd4-4961-8172-5d685fa3e3a7 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba" status: 404 len: 111 microversion: 2.1 time: 0.188730 Aug 31 05:21:28.241324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 196/400] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:28 2022] GET /compute/v2.1/servers/e62b4b35-ef52-40c6-b02c-2bfc22cbb1ba => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:28.293116 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:28.294365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:28.302523 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:28.303319 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:28.304441 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:28.305275 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:28.306236 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:28.307169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:28.379875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:28.379875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:28.383671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:28.384261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:28.384847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:28.385697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:28.386304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:28.386859 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:28.553379 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:28.562298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0751a5a3-7606-4b68-8771-e7ad4ef9ec58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.275381 Aug 31 05:21:28.562883 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 205/401] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:28 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:28.568626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1475595751", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "networks": [{"uuid": "0bd5033b-afa0-4bbd-bae1-89210deb8646"}]}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:28.633409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:28.643780 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.network.neutron [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] validate_networks() for [('0bd5033b-afa0-4bbd-bae1-89210deb8646', None, None, None, None, None)] {{(pid=120607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:21:28.647516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-950bb8f0-ae16-4273-8ea2-41d6188cca95 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.274798 Aug 31 05:21:28.648055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 197/402] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:28 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:29.268323 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Flavor limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:21:29.268808 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Image limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:21:29.269364 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Flavor pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:21:29.269943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Image pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:21:29.270566 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:21:29.280969 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:29.281481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:29.281949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:29.282721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:29.283189 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:29.283633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:29.300494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Getting quotas for project 04da0465aa794d208d6dd9e2aab7d704. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:21:29.304540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Getting quotas for user 9d7f48e1763e4ff3b77ddb90e65045b0 and project 04da0465aa794d208d6dd9e2aab7d704. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:21:29.316392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Going to run 1 instances... {{(pid=120607) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:21:29.318765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:21:29.365005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fe6503b3-6a30-4d68-b405-afa3fd670f18 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800100 Aug 31 05:21:29.365636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 206/403] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:21:29.377255 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9dd993f5-c862-4724-9d75-d9314ca851d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:29.377854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9dd993f5-c862-4724-9d75-d9314ca851d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:29.443977 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9dd993f5-c862-4724-9d75-d9314ca851d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:29.450925 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9dd993f5-c862-4724-9d75-d9314ca851d8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1214 microversion: 2.1 time: 0.078217 Aug 31 05:21:29.451480 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 198/404] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:29 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:29.588491 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:29.589092 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:29.596026 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:29.596691 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:29.597102 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:29.597773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:29.598244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:29.598653 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:29.670044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:29.670889 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:29.677161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:29.677844 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:29.678557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:29.679712 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:29.680568 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:29.681221 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:29.777393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:29.785317 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-934c9498-306c-4d3c-be5f-5d3ab300b945 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.201472 Aug 31 05:21:29.785968 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 207/405] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:29 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:29.842802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:29.852261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1c7210c4-f75b-443e-890d-d306f2dfa08a tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.186755 Aug 31 05:21:29.852955 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 199/406] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:29 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:30.476746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:30.478572 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:30.489242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:30.489827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:30.490361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:30.491129 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:30.491645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:30.492129 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:30.565428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:30.575523 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-66256eba-705c-4514-8298-f521af8c0be1 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1266 microversion: 2.1 time: 0.107457 Aug 31 05:21:30.576604 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 208/407] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:30 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:30.809276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:30.810159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:30.818971 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:30.819646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:30.820247 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:30.821204 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:30.821868 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:30.822504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:30.873461 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:30.874102 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:30.880631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:30.881183 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:30.881702 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:30.882490 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:30.883001 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:30.883483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:31.005811 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:31.014132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-924b29dd-53b4-4001-be49-0e0a996f5546 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.210362 Aug 31 05:21:31.014888 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 200/408] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:30 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:31.058609 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:31.067423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-49adaab7-7c4c-4f32-b862-87f1e9713fb6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.197777 Aug 31 05:21:31.068026 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 209/409] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:30 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:31.597107 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:31.597700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:31.604443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:31.604922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:31.605347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:31.606035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:31.606507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:31.606879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:31.675655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:31.683849 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0e9a2b0e-08cc-4cfc-9c62-8ef3f048de83 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1266 microversion: 2.1 time: 0.090692 Aug 31 05:21:31.684593 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 201/410] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:31 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:32.036561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:32.037157 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:32.043780 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:32.044250 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:32.044680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:32.045344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:32.045775 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:32.046330 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:32.088667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:32.089380 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:32.096097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:32.096677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:32.097173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:32.097959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:32.098532 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:32.099068 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:32.239395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:32.247337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ee2f4931-be3d-4a8b-b3f5-3a73ab96ce0b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.214576 Aug 31 05:21:32.248081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 210/411] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:32 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:32.269476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:32.277791 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d707f674-d527-4eec-bbc7-6659446ce96b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.192977 Aug 31 05:21:32.278401 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 202/412] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:32 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:32.704772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:32.705578 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:32.712190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:32.712828 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:32.713298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:32.714116 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:32.714624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:32.715492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:32.796684 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:32.804601 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d7240fd2-1277-4a37-a07d-d90a7c4e97f6 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1274 microversion: 2.1 time: 0.103653 Aug 31 05:21:32.805080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 211/413] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:32 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:33.268114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:33.268761 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:33.276151 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:33.277172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:33.277800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:33.278526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:33.278967 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:33.279366 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:33.308344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:33.309873 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:33.317563 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:33.318427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:33.319038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:33.319868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:33.320468 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:33.321002 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:33.594990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:33.600875 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:33.614689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-259e25af-83a9-41d1-9d24-776a5ea9248c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.313506 Aug 31 05:21:33.629407 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 212/414] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:33 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:33.635398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-063fe46e-fc87-4faf-98aa-a73023b76e2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.370597 Aug 31 05:21:33.657784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 203/415] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:33 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:33.826126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:33.826627 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:33.833420 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:33.834169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:33.834751 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:33.835580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:33.836184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:33.836584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:34.066867 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:34.083091 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c89c8274-2bce-4ca4-aaf5-5112f2546879 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.260314 Aug 31 05:21:34.084523 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 213/416] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:33 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:34.362831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-f97dd233-7373-49af-b827-3b74e0227e1a req-82fe7954-1764-45d3-bc79-543f353e748b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7af809e8-b9d3-4416-996d-05fd5b177253", "tag": "6fb9509f-5a6f-4198-87aa-a3fc529a793a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:34.379714 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f97dd233-7373-49af-b827-3b74e0227e1a req-82fe7954-1764-45d3-bc79-543f353e748b service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:34.380415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f97dd233-7373-49af-b827-3b74e0227e1a req-82fe7954-1764-45d3-bc79-543f353e748b service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:34.381040 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f97dd233-7373-49af-b827-3b74e0227e1a req-82fe7954-1764-45d3-bc79-543f353e748b service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:34.392623 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-f97dd233-7373-49af-b827-3b74e0227e1a req-82fe7954-1764-45d3-bc79-543f353e748b service nova] Creating event network-changed:6fb9509f-5a6f-4198-87aa-a3fc529a793a for instance 7af809e8-b9d3-4416-996d-05fd5b177253 on hv-cinder-85220 Aug 31 05:21:34.401265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-f97dd233-7373-49af-b827-3b74e0227e1a req-82fe7954-1764-45d3-bc79-543f353e748b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042001 Aug 31 05:21:34.402601 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 204/417] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:34.640549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:34.641855 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:34.649433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:34.649915 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:34.650428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:34.651129 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:34.651574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:34.651991 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:34.656564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:34.664674 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:34.665779 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:34.675477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:34.676224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:34.677025 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:34.678060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:34.678828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:34.679389 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:34.984738 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:34.992104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:34.999918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-80f9989e-26f5-4435-bd34-e1f2a1bae629 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.364953 Aug 31 05:21:35.003344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 214/418] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:34 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:35.017040 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-50e2dc9e-aed3-47c7-b454-e1d44e294ca6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.358050 Aug 31 05:21:35.017934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 205/419] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:34 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:35.104575 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:35.105667 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:35.112110 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:35.112587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:35.113002 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:35.113684 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:35.114146 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:35.114557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:35.251416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:35.261443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6928c987-74ce-4f1a-a11f-53e7dd09b3a4 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.159125 Aug 31 05:21:35.262035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 215/420] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:35 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:36.020273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:36.020893 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:36.027482 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:36.028075 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:36.028649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:36.029428 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:36.029873 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:36.030321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:36.038604 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:36.039797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:36.047341 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:36.048089 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:36.048703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:36.049407 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:36.050127 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:36.050608 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:36.230151 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:36.237113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:36.238787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-46f5ad8c-1073-4e9f-9698-fe4bebb12cde tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.222614 Aug 31 05:21:36.239366 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 206/421] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:36 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:36.245118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6f864046-778e-453e-855d-76786c67c32d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.210555 Aug 31 05:21:36.245681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 216/422] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:36 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:36.282035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:36.282651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:36.289104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:36.289307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:36.289717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:36.290422 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:36.290861 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:36.291269 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:36.426969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:36.434725 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-457f6b7c-404a-4162-8ffe-7388ea6dabe2 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.156534 Aug 31 05:21:36.435295 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 207/423] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:36 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:36.576357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-f0ee306b-d624-4e74-ba4e-c29cdf3007e0 req-c6566429-720e-4b79-869c-e6e58cff205e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84115827-b1df-419c-b693-8b9105afcbbd", "name": "network-vif-plugged", "status": "completed", "tag": "3a5ee679-8365-4a8d-a3d4-4874a75745af"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:36.585983 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-f0ee306b-d624-4e74-ba4e-c29cdf3007e0 req-c6566429-720e-4b79-869c-e6e58cff205e service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:36.586482 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-f0ee306b-d624-4e74-ba4e-c29cdf3007e0 req-c6566429-720e-4b79-869c-e6e58cff205e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:36.586895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-f0ee306b-d624-4e74-ba4e-c29cdf3007e0 req-c6566429-720e-4b79-869c-e6e58cff205e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:36.597796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-f0ee306b-d624-4e74-ba4e-c29cdf3007e0 req-c6566429-720e-4b79-869c-e6e58cff205e service nova] Creating event network-vif-plugged:3a5ee679-8365-4a8d-a3d4-4874a75745af for instance 84115827-b1df-419c-b693-8b9105afcbbd on hv-cinder-85220 Aug 31 05:21:36.602950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-f0ee306b-d624-4e74-ba4e-c29cdf3007e0 req-c6566429-720e-4b79-869c-e6e58cff205e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Aug 31 05:21:36.603549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 217/424] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:37.260354 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:37.261666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:37.266865 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:37.267559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:37.268204 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:37.268675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:37.269097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:37.269793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:37.270272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:37.270683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:37.274138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:37.274618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:37.275039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:37.275707 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:37.276146 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:37.276560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:37.467529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:37.470964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:37.475541 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-680abf21-8659-4dd2-a304-503821f890a5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.219097 Aug 31 05:21:37.476171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 208/425] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:37 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:37.479154 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-caf9a143-b2ae-401d-a6cf-59e3e4484d4a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.217183 Aug 31 05:21:37.479706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 218/426] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:37 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:37.480735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:37.481330 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:37.487868 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:37.488347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:37.488765 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:37.489472 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:37.489914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:37.490354 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:37.627458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:37.635590 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ca34d954-1beb-4e81-b788-7118458d0404 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.158355 Aug 31 05:21:37.636129 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 209/427] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:37 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:38.499256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:38.500208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:38.500745 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:38.501319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:38.508490 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:38.509388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:38.510226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:38.510776 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:38.510964 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:38.511334 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:38.512021 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:38.512655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:38.512914 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:38.513464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:38.513798 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:38.514424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:38.872414 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:38.884912 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0dc15cf2-906d-4bef-9204-135a724d2769 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.387886 Aug 31 05:21:38.886942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 210/428] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:38 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:38.892473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:38.893311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:38.899900 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:38.900631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:38.901208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:38.902643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:38.903271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:38.903690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:38.909232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:38.917451 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:38.919231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-94656c3f-a096-4f66-b61c-9763167a4d37 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.424143 Aug 31 05:21:38.920362 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 219/429] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:38 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:39.060412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:39.068346 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7483818c-fb61-4981-90e4-bed802a1eac0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.180241 Aug 31 05:21:39.068913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 211/430] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:38 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:39.912845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:39.913807 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:39.916876 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:39.917934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:39.927774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:39.928555 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:39.929261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:39.930409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:39.931136 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:39.931812 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:39.939795 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:39.940521 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:39.942479 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:39.948057 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:39.948534 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:39.948949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:39.949624 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:39.950078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:39.950506 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:40.133363 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:40.141588 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-981a65a9-f69c-4b9e-8ae6-e6f0bd6ccffa tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.235256 Aug 31 05:21:40.142193 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 220/431] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:39 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:40.142369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:40.146559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:40.147185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:40.150449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dd488d13-45c8-47b9-bae8-e4516e00e785 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1260 microversion: 2.1 time: 0.214417 Aug 31 05:21:40.151467 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 212/432] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:39 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:40.153154 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:40.153633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:40.154055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:40.154737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:40.155174 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:40.155577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:40.291030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:40.298798 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-db978e68-7e2c-414b-add2-7bed629c7382 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.155667 Aug 31 05:21:40.299371 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 221/433] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:40 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:40.886633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-0cfa9938-03ff-459f-9bcf-45368eea5e8a req-f46aaadf-452d-4ff0-81bb-fbb1075f90f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af809e8-b9d3-4416-996d-05fd5b177253", "name": "network-vif-plugged", "status": "completed", "tag": "6fb9509f-5a6f-4198-87aa-a3fc529a793a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:40.902114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0cfa9938-03ff-459f-9bcf-45368eea5e8a req-f46aaadf-452d-4ff0-81bb-fbb1075f90f1 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:40.902522 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0cfa9938-03ff-459f-9bcf-45368eea5e8a req-f46aaadf-452d-4ff0-81bb-fbb1075f90f1 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:40.902906 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0cfa9938-03ff-459f-9bcf-45368eea5e8a req-f46aaadf-452d-4ff0-81bb-fbb1075f90f1 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:40.921687 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-0cfa9938-03ff-459f-9bcf-45368eea5e8a req-f46aaadf-452d-4ff0-81bb-fbb1075f90f1 service nova] Creating event network-vif-plugged:6fb9509f-5a6f-4198-87aa-a3fc529a793a for instance 7af809e8-b9d3-4416-996d-05fd5b177253 on hv-cinder-85220 Aug 31 05:21:40.926789 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-0cfa9938-03ff-459f-9bcf-45368eea5e8a req-f46aaadf-452d-4ff0-81bb-fbb1075f90f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044555 Aug 31 05:21:40.927995 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 213/434] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:41.161494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:41.162112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:41.173214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:41.173721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:41.179675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:41.180146 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:41.180565 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:41.181249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:41.181690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:41.182240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:41.182910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:41.183399 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:41.186044 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:41.187257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:41.188472 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:41.189081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:41.397850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:41.406285 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-177f871c-1400-42b9-aee8-aec871298a74 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1444 microversion: 2.1 time: 0.237771 Aug 31 05:21:41.406850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 214/435] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:41 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1444 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:41.410623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:41.418979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f3295713-2c10-49e1-9732-c2c3e7ae225a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.260983 Aug 31 05:21:41.421821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:41.422673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:41.427626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 222/436] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:41 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:41.428829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:41.429466 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:41.430081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:41.431080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:41.431737 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:41.432969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:41.433097 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:41.433806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:41.440388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:41.441095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:41.441512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:41.442233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:41.442677 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:41.443092 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:41.675323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:41.684982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9e6c0896-f58c-4249-98a8-09d2b5e07a5b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.270135 Aug 31 05:21:41.691044 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:41.698635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 215/437] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:41 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:41.699476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ed9ef63d-c936-4e11-96ca-824d0924905b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1444 microversion: 2.1 time: 0.270598 Aug 31 05:21:41.700031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 223/438] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:41 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1444 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:42.443163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:42.445133 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:42.460603 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:42.461350 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:42.461784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:42.465666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:42.467943 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:42.469821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:42.706524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:42.708053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:42.715269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:42.716023 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:42.717503 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:42.719378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:42.720330 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:42.720970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:42.753363 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:42.763711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-18dcb340-e37c-4013-9870-dc2ad6a4de25 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.326657 Aug 31 05:21:42.766475 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 216/439] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:42 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:42.968038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:42.976059 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-139f83c9-8b73-42ad-af47-8cf48f0596f0 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.274685 Aug 31 05:21:42.976872 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 224/440] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:42 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:43.787560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:43.788036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:43.795120 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:43.795646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:43.796216 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:43.796960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:43.797398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:43.797858 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:43.999018 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:44.001650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:44.009359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:44.010765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:44.011416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:44.011969 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:44.012545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:44.013156 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:44.024719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:44.035110 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a33da837-12e6-4ae7-aedb-359460c7da80 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.252142 Aug 31 05:21:44.036478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 217/441] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:43 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:44.512500 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:44.519301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-72020f03-e90f-4cb6-9255-c7892c575508 req-0d14ad0c-1ae5-4840-909b-a5d7ec7abee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84115827-b1df-419c-b693-8b9105afcbbd", "tag": "3a5ee679-8365-4a8d-a3d4-4874a75745af"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:44.520314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0e1fbcf8-9f18-43a4-9965-95d8f0380a57 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1314 microversion: 2.1 time: 0.526547 Aug 31 05:21:44.520895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 225/442] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:43 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:44.540341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-72020f03-e90f-4cb6-9255-c7892c575508 req-0d14ad0c-1ae5-4840-909b-a5d7ec7abee4 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:44.542699 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-72020f03-e90f-4cb6-9255-c7892c575508 req-0d14ad0c-1ae5-4840-909b-a5d7ec7abee4 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:44.547447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-72020f03-e90f-4cb6-9255-c7892c575508 req-0d14ad0c-1ae5-4840-909b-a5d7ec7abee4 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:44.594793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-72020f03-e90f-4cb6-9255-c7892c575508 req-0d14ad0c-1ae5-4840-909b-a5d7ec7abee4 service nova] Creating event network-changed:3a5ee679-8365-4a8d-a3d4-4874a75745af for instance 84115827-b1df-419c-b693-8b9105afcbbd on hv-cinder-85220 Aug 31 05:21:44.606097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-72020f03-e90f-4cb6-9255-c7892c575508 req-0d14ad0c-1ae5-4840-909b-a5d7ec7abee4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092989 Aug 31 05:21:44.608890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 218/443] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:45.059893 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:45.060537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:45.075297 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:45.077424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:45.078039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:45.080461 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:45.081078 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:45.082565 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:45.498239 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:45.508277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1639c24d-17eb-4f46-be4d-e865d9bb27c2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.454665 Aug 31 05:21:45.511195 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 226/444] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:45 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:45.541699 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:45.543216 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:45.554391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:45.557054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:45.567219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:45.568272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:45.568907 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:45.569483 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:45.827434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:45.843677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-366d237a-17a0-4e15-a791-8735031c3667 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1499 microversion: 2.1 time: 0.305355 Aug 31 05:21:45.845310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 219/445] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:45 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1499 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:46.532207 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:46.532672 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:46.539596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:46.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:46.540516 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:46.541203 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:46.544048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:46.544917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:46.569845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:46.572131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:46.580464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:46.581042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:46.581534 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:46.582446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:46.583887 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:46.584391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:46.612847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:21:46.778907 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-37a35327-e49a-4ffc-9a3c-a0dae773bc2a tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 204 len: 0 microversion: 2.1 time: 0.212661 Aug 31 05:21:46.781648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 220/446] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:21:46 2022] DELETE /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 05:21:46.800910 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:46.802112 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:46.808590 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:46.809330 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:46.809902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:46.810786 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:46.811547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:46.812222 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:46.978336 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:46.989354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6aa881f0-8820-45c9-bab9-1a122e8baf69 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.461194 Aug 31 05:21:46.991220 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 227/447] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:46 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:47.061256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:47.071958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ff718070-61c5-4a56-8b72-4cb626c914bd tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1505 microversion: 2.1 time: 0.279124 Aug 31 05:21:47.072619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 221/448] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:46 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:48.011661 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:48.012253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:48.022744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:48.023227 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:48.023688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:48.024379 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:48.024827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:48.025275 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:48.093700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:48.094401 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:48.100613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:48.101157 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:48.101810 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:48.102712 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:48.103221 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:48.103721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:48.299300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:48.316321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1a8755e3-aece-4609-9e15-bbd8d4048a98 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.308192 Aug 31 05:21:48.317529 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 228/449] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:48 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:48.343527 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:48.352016 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-37ed027a-2260-4fb6-b983-a4fa60c76be8 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1505 microversion: 2.1 time: 0.263022 Aug 31 05:21:48.353110 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 222/450] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:48 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:21:49.338926 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:49.339571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:49.357155 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:49.360622 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:49.361128 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:49.361869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:49.365102 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:49.365547 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:49.375097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:49.375720 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:49.388143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:49.388640 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:49.389062 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:49.389779 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:49.394934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:49.395453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:49.921509 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:49.925030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:49.937975 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8a87ed86-de3c-4990-8299-d33ef0c9d08a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.603484 Aug 31 05:21:49.939098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-20812db3-eb70-4101-ab0e-e22dc211fa02 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1505 microversion: 2.1 time: 0.568675 Aug 31 05:21:49.939543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 229/451] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:49 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:49.942342 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 223/452] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:49 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:50.129941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-86d346b9-15b5-453f-b873-d2f7dbeb524f req-b9e34521-81f6-4b71-991a-36b60d4128d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7af809e8-b9d3-4416-996d-05fd5b177253", "name": "network-vif-deleted", "tag": "6fb9509f-5a6f-4198-87aa-a3fc529a793a"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:21:50.143111 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-86d346b9-15b5-453f-b873-d2f7dbeb524f req-b9e34521-81f6-4b71-991a-36b60d4128d7 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:50.143837 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-86d346b9-15b5-453f-b873-d2f7dbeb524f req-b9e34521-81f6-4b71-991a-36b60d4128d7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:50.144390 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-86d346b9-15b5-453f-b873-d2f7dbeb524f req-b9e34521-81f6-4b71-991a-36b60d4128d7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:50.156512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-86d346b9-15b5-453f-b873-d2f7dbeb524f req-b9e34521-81f6-4b71-991a-36b60d4128d7 service nova] Creating event network-vif-deleted:6fb9509f-5a6f-4198-87aa-a3fc529a793a for instance 7af809e8-b9d3-4416-996d-05fd5b177253 on hv-cinder-85220 Aug 31 05:21:50.161746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-86d346b9-15b5-453f-b873-d2f7dbeb524f req-b9e34521-81f6-4b71-991a-36b60d4128d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035770 Aug 31 05:21:50.162404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 230/453] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:21:50.965172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:50.966650 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:50.977811 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:50.979249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:50.992707 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:50.993575 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:50.997147 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:50.997755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:50.998671 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:50.999354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:51.000239 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:51.000529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:51.001061 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:51.001445 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:51.002552 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:51.002701 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:51.167987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:51.189467 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7544823b-0bb1-4b53-9c39-26aa620a781c tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1463 microversion: 2.1 time: 0.228304 Aug 31 05:21:51.191178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 224/454] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:50 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1463 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:51.299035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:51.315363 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8d078b96-7d6c-43e5-8987-ea24de2ebddb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.342597 Aug 31 05:21:51.328654 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 231/455] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:50 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:52.211460 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:52.212020 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:52.218371 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:52.218865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:52.219247 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:52.220140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:52.220579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:52.220964 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:52.312636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:52.324621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-63260bfc-3fe1-47d2-a593-cda92509b754 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1463 microversion: 2.1 time: 0.116876 Aug 31 05:21:52.325931 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 225/456] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:52 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1463 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:52.346483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:52.349568 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:52.366996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:52.367779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:52.368426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:52.369348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:52.369947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:52.370550 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:52.376607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:52.583095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:52.592356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8206a47c-b48d-4f0f-9c97-79358397d15d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.249828 Aug 31 05:21:52.592968 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 232/457] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:52 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:53.349662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:53.350398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:53.353660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:53.358836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:53.359707 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:53.360211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:53.361011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:53.361523 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:53.362090 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:53.432836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:53.441253 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-464078e2-64c3-4739-b51e-2f50a284c2ab tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1463 microversion: 2.1 time: 0.097065 Aug 31 05:21:53.441869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 226/458] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:53 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1463 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:53.613524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:53.615157 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:53.623376 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:53.624226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:53.624821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:53.625723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:53.626388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:53.626984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:53.909411 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:53.917774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-042f741e-df92-4032-b0f6-e34c0b1da453 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.308434 Aug 31 05:21:53.930263 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 233/459] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:53 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:54.473720 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:54.475394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:54.493715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:54.494455 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:54.496268 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:54.498257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:54.499791 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:54.505766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:54.538372 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:54.565282 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:54.565763 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:54.566222 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:54.566661 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lazy-loading 'fault' on Instance uuid 7af809e8-b9d3-4416-996d-05fd5b177253 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:21:54.634329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7f48e1763e4ff3b77ddb90e65045b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04da0465aa794d208d6dd9e2aab7d704', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:54.642446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-88479495-06eb-43b4-b0d3-bdb16e770b34 tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 200 len: 1304 microversion: 2.1 time: 0.183736 Aug 31 05:21:54.643809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 227/460] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:54 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 1304 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:54.940892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:54.942314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:54.948208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:54.950057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:54.950688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:54.951330 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:54.952397 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:54.953104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:54.953660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:55.129608 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:55.138107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9ea75d79-d5e3-47f4-8451-a54206cadd88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.201619 Aug 31 05:21:55.139962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 234/461] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:54 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:55.670214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:55.671668 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] [instance: 7af809e8-b9d3-4416-996d-05fd5b177253] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:55.683153 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:55.687345 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:55.691096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:55.693636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:55.696204 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:55.698707 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:55.743115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] HTTP exception thrown: Instance 7af809e8-b9d3-4416-996d-05fd5b177253 could not be found. Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Request method failure captured: Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 HTTP/1.1 Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu-ZQgMr8KWkfma4a8SG5AYN15T6y0A6cPOGYT6EP2EvZ5-Ba67NkfEFt3htmzKY2H5Hn9Coh2jLT6Vtz9d8cP_b0FURLCCyGXgg2C1FDedpaFQCeDQQ9b6RprAcEXjwYQM3MB-uJ3PwkL1Xk3cUJkhCXmaX7gnnuAelwvv5KpZluq0 Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 04da0465aa794d208d6dd9e2aab7d704 Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesActionsTest-739832668 Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:21:55.745232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04da0465aa794d208d6dd9e2aab7d704"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_04da0465aa794d208d6dd9e2aab7d704", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/04da0465aa794d208d6dd9e2aab7d704"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/04da0465aa794d208d6dd9e2aab7d704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesActionsTest-739832668 Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 04da0465aa794d208d6dd9e2aab7d704 Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesActionsTest-739832668 Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesActionsTest-739832668-project Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 9d7f48e1763e4ff3b77ddb90e65045b0 Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesActionsTest-739832668-project Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 7af809e8-b9d3-4416-996d-05fd5b177253 could not be found. Aug 31 05:21:55.746872 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '7af809e8-b9d3-4416-996d-05fd5b177253'} Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7af809e8-b9d3-4416-996d-05fd5b177253 could not be found. Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:21:55.747634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7af809e8-b9d3-4416-996d-05fd5b177253 could not be found. Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7af809e8-b9d3-4416-996d-05fd5b177253 could not be found. Aug 31 05:21:55.748959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:21:55.752193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] Returning 404 to user: Instance 7af809e8-b9d3-4416-996d-05fd5b177253 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:21:55.753305 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f7b71e25-b24b-40b3-aafd-1a15130ea74b tempest-VolumesActionsTest-739832668 tempest-VolumesActionsTest-739832668-project] 10.222.0.36 "GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253" status: 404 len: 111 microversion: 2.1 time: 0.093077 Aug 31 05:21:55.754143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 228/462] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:55 2022] GET /compute/v2.1/servers/7af809e8-b9d3-4416-996d-05fd5b177253 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:56.160472 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:56.161076 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:56.174985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:56.175232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:56.176191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:56.180773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:56.181317 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:56.183293 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:56.396467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:56.405448 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5b253c0f-b2e2-4388-ba3e-aa1fe5d346e0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.249156 Aug 31 05:21:56.419233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 235/463] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:56 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:57.428892 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:57.430354 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:57.436823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:57.437543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:57.437970 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:57.438676 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:57.439117 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:57.439526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:57.582382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:57.593602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ff985b25-ef5d-47f0-9cf8-313e72f42b0a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.168636 Aug 31 05:21:57.594751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 229/464] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:57 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:58.615558 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:58.616771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:58.625538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:58.626304 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:58.626728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:58.627417 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:58.627851 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:58.628250 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:58.811752 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:21:58.822184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-83bde47c-f909-4e31-8b4d-c75fe10c2ffd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.210482 Aug 31 05:21:58.834028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 236/465] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:58 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:21:59.847109 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:21:59.850445 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:21:59.867748 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:59.868673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:59.871844 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:21:59.873885 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:21:59.876083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:21:59.876942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:00.042499 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:00.054120 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3f2022b3-d581-45c2-b66f-f0c989e2b48a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.214766 Aug 31 05:22:00.067790 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 230/466] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:21:59 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:01.075610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:01.077096 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:01.084289 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:01.084776 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:01.085205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:01.085897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:01.086655 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:01.087105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:01.254535 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:01.265868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-92634fb2-162d-48ec-ba56-6a3ffeb9064c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.194510 Aug 31 05:22:01.266497 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 237/467] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:01 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:02.287463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:02.288081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:02.296741 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:02.297665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:02.298319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:02.299232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:02.299857 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:02.300716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:02.440246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:02.448291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9ead7ebf-10f2-4b91-a43d-272a2727fc71 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.164782 Aug 31 05:22:02.462389 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 231/468] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:02 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:02.869827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9368bad9-3574-4793-a1f5-c37d4cd841b6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Action: 'create', calling method: .version_select at 0x7fbd0b463dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-107287607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwINu/kx1uKRPkyQgccc4U40XumiFJl8PAN1aVyQciXteGI+4gJ1/fBNSe3Jo3pe5ksF8Jb/y6c0jMiBdP+uivlDz1j04LqywrtRVoiRtQHfSVZGTOJjllut86INn/bDw=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:02.885718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-9368bad9-3574-4793-a1f5-c37d4cd841b6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Getting quotas for project 4ad69415b75d4d259c8cd31e05b2a505. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:22:02.889553 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-9368bad9-3574-4793-a1f5-c37d4cd841b6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Getting quotas for user 57600fcb074741e782f0eda3ae51e6dd and project 4ad69415b75d4d259c8cd31e05b2a505. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:22:02.901645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9368bad9-3574-4793-a1f5-c37d4cd841b6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [01316a26-b6f3-4a66-8744-baf401be69d9] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 05:22:03.472848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:03.473744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:03.481754 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:03.482585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:03.483005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:03.483678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:03.484116 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:03.484496 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:03.620904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:03.629053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ad68f349-e616-4b34-8f84-f391b5eff4eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.162785 Aug 31 05:22:03.629615 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 232/469] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:03 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:03.912435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [None req-9368bad9-3574-4793-a1f5-c37d4cd841b6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [01316a26-b6f3-4a66-8744-baf401be69d9] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 41154. Aug 31 05:22:03.937294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9368bad9-3574-4793-a1f5-c37d4cd841b6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.071393 Aug 31 05:22:03.938059 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 238/470] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:22:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:22:03.992544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1963189048", "imageRef": "59663c22-99ad-4376-b2a4-28c8a398a934", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-107287607", "networks": [{"uuid": "fbe99319-aa5c-407a-bf7e-530d4443375c"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:04.044766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] validate_networks() for [('fbe99319-aa5c-407a-bf7e-530d4443375c', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:22:04.438323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:22:04.438859 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:22:04.439580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:22:04.440296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:22:04.441102 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:22:04.454609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:04.455284 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:04.455886 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:04.457042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:04.457667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:04.458326 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:04.478182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Getting quotas for project 4ad69415b75d4d259c8cd31e05b2a505. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:22:04.482700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Getting quotas for user 57600fcb074741e782f0eda3ae51e6dd and project 4ad69415b75d4d259c8cd31e05b2a505. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:22:04.495184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:22:04.497775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='59663c22-99ad-4376-b2a4-28c8a398a934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:22:04.546531 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e83385e3-9e92-4333-9e37-a26f1b0632e1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557830 Aug 31 05:22:04.547355 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 233/471] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:22:04.557996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-486628a2-9fb9-434d-ae2e-5fb016627015 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:04.558623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-486628a2-9fb9-434d-ae2e-5fb016627015 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:04.614292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-486628a2-9fb9-434d-ae2e-5fb016627015 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:04.621852 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-486628a2-9fb9-434d-ae2e-5fb016627015 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1258 microversion: 2.1 time: 0.067817 Aug 31 05:22:04.622799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 239/472] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:04 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:04.649801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:04.650437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:04.656777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:04.657225 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:04.657647 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:04.658341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:04.658774 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:04.659176 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:04.855433 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:04.871983 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-313c8325-2beb-4c65-b1ac-770bf83830eb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.225652 Aug 31 05:22:04.872837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 234/473] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:04 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:05.643555 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:05.644152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:05.651651 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:05.652361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:05.652965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:05.653821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:05.654466 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:05.655082 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:05.717736 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:05.726143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b3d0952d-e8ad-48ef-966c-76bd991dad85 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1254 microversion: 2.1 time: 0.086346 Aug 31 05:22:05.726727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 240/474] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:05 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1254 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:05.892839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:05.893542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:05.903184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:05.904177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:05.905113 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:05.906528 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:05.907440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:05.908422 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:06.060874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:06.070698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e0e908ff-2278-4f02-a80b-b4a643f94d47 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.181819 Aug 31 05:22:06.071294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 235/475] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:05 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:06.747986 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:06.749503 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:06.758500 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:06.759454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:06.760120 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:06.761034 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:06.761737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:06.762230 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:06.831228 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:06.839587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-45e1d053-b2e3-4707-94c4-75ca2928b1f8 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1310 microversion: 2.1 time: 0.095617 Aug 31 05:22:06.850327 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 241/476] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:06 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:07.091505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:07.092099 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:07.098397 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:07.099135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:07.099553 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:07.100470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:07.100954 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:07.101370 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:07.237852 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:07.246445 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-73e44918-6d93-4115-9688-90ade05c0b56 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.158899 Aug 31 05:22:07.252719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 236/477] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:07 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:07.861975 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:07.862635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:07.870272 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:07.871179 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:07.872025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:07.872900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:07.873496 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:07.874098 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:07.952137 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:07.962044 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2112a60d-8539-4ccb-828d-dc9a7ef0adba tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1310 microversion: 2.1 time: 0.104602 Aug 31 05:22:07.962928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 242/478] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:07 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:08.268947 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:08.270324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:08.276948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:08.277665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:08.278103 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:08.279010 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:08.280058 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:08.280675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:08.423801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:08.432088 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e58c0d37-5383-42f5-b206-dd380216ba99 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.167037 Aug 31 05:22:08.433233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 237/479] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:08 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:08.985197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:08.985885 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:08.993346 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:08.993836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:08.994289 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:08.994964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:08.995691 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:08.996104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:09.064711 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:09.074540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-656a3aa7-a272-43dd-bf08-bc22bbf4768c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1310 microversion: 2.1 time: 0.093859 Aug 31 05:22:09.075634 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 243/480] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:08 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:09.453431 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:09.454072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:09.460480 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:09.461172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:09.461597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:09.462633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:09.463085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:09.463486 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:09.633546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:09.645452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dd73c569-fb76-4d58-ab39-66f563ad2fe4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.195476 Aug 31 05:22:09.658646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 238/481] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:09 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:10.096719 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:10.097993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:10.108017 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:10.108817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:10.109450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:10.110380 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:10.111312 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:10.111918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:10.200216 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:10.209174 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-817e4bbf-a734-47e8-a87a-36096d5027fe tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1310 microversion: 2.1 time: 0.116837 Aug 31 05:22:10.210032 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 244/482] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:10 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1310 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:10.670927 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:10.671662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:10.678798 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:10.679491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:10.681809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:10.682681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:10.683309 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:10.683722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:10.823436 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:10.832123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-79baf142-c651-44e0-bfdf-bced10ef9fb4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1521 microversion: 2.1 time: 0.166177 Aug 31 05:22:10.845758 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 239/483] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:10 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:11.232349 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:11.233013 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:11.240004 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:11.240502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:11.240939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:11.241796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:11.242268 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:11.242737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:11.307113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:11.318653 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0e536586-79ae-46c8-9163-43e324c5b0f6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1310 microversion: 2.1 time: 0.091140 Aug 31 05:22:11.319303 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 245/484] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:11 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:11.853503 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:11.854948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:11.862275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:11.863048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:11.863819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:11.864628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:11.865215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:11.865667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:12.049019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:12.064665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3dd70e0f-a07a-4e97-8bed-d199961bf732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1501 microversion: 2.1 time: 0.213614 Aug 31 05:22:12.065660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 240/485] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:11 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1501 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:12.092194 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:12.093334 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:12.105541 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:12.106561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:12.107796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:12.108652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:12.109232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:12.109985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:12.339846 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:12.340737 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:12.347152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:12.347699 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:12.348183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:12.348920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:12.349424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:12.349892 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:12.434782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:12.442917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:12.443823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-14f08046-db0e-477d-99b5-400720657312 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1316 microversion: 2.1 time: 0.107626 Aug 31 05:22:12.444620 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 241/486] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:12 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:12.453227 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cca7af02-c790-4463-ab50-f1d54d1164d4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1514 microversion: 2.1 time: 0.367573 Aug 31 05:22:12.454242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 246/487] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:12 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:13.477894 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:13.478689 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:13.486085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:13.486854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:13.487492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:13.488183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:13.488629 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:13.489095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:13.611446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:13.622661 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-69431f63-c1ee-44e8-b7c1-c16d7f610eac tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1316 microversion: 2.1 time: 0.152930 Aug 31 05:22:13.626317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 242/488] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:13 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:14.645241 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:14.646785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:14.649688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:14.656687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:14.657567 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:14.658257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:14.659168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:14.659866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:14.660493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:14.962361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:14.978365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d7855e2a-cdb0-43d9-a7a7-f71e5c619f77 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.336217 Aug 31 05:22:14.979804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 247/489] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:14 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:15.182241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:15.184827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:15.195539 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:15.196721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:15.198809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:15.199706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:15.200412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:15.201277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:15.201874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:15.202469 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:15.229933 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lazy-loading 'flavor' on Instance uuid b72dc747-3be8-4092-b09d-1d6943280b33 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:22:15.316528 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:15.353060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f582c812-0863-4a68-9060-7302847bc1b0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33/action" status: 200 len: 32 microversion: 2.1 time: 0.175436 Aug 31 05:22:15.353673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 243/490] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:22:15 2022] POST /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:22:15.363549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:15.364140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:15.374968 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:15.375475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:15.375913 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:15.376837 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:15.377555 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:15.377978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:15.547640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:15.557314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-644825ec-f69d-4e52-a1ac-de178a5526e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.197339 Aug 31 05:22:15.562062 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 248/491] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:15 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:16.012845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:16.015354 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:16.033938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:16.034818 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:16.035911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:16.037619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:16.039124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:16.040319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:16.230214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:16.242133 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-89c3b747-b150-4aed-bc2a-8361dca8d2aa tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.238050 Aug 31 05:22:16.254031 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 244/492] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:15 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:16.585774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:16.585774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:16.591862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:16.592406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:16.592899 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:16.593659 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:16.594198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:16.594688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:16.746719 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:16.761193 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-033f8105-1085-4eca-9f30-871b92396d88 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.181863 Aug 31 05:22:16.762423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 249/493] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:16 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:17.267828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:17.268587 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:17.275842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:17.276731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:17.277491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:17.278557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:17.279306 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:17.280024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:17.533288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:17.559635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a4f4447d-cf68-4a4a-98f4-77ce11a22ea3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.284583 Aug 31 05:22:17.562168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 245/494] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:17 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:17.787592 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:17.789109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:17.803932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:17.807854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:17.808569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:17.810064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:17.810064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:17.813162 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:17.984030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:17.988152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:17.993359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9e146416-d8e6-4ecf-9773-5eb883b5bde0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.212117 Aug 31 05:22:17.994092 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 250/495] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:17 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:18.571500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:18.576076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:18.592019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:18.592840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:18.593510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:18.594453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:18.595100 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:18.598506 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:18.833127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:18.843132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e1998b2d-b16d-4194-9eca-f1db562df86c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.275664 Aug 31 05:22:18.843713 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 246/496] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:18 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:19.016382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:19.016988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:19.026514 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:19.027430 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:19.028312 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:19.029596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:19.030594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:19.031504 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:19.300149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:19.310670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0eb8875e-fb17-41e4-8c08-c3fba97af9b3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.299294 Aug 31 05:22:19.330855 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 251/497] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:19 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:19.869462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:19.870802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:19.894525 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:19.895268 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:19.895865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:19.896722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:19.902249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:19.903021 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:20.148442 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:20.162065 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a2c81314-beca-4657-a2f7-afaa0c85e40f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.296948 Aug 31 05:22:20.163178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 247/498] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:19 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:20.341847 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:20.349800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:20.364225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:20.366138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:20.370999 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:20.373524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:20.376008 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:20.376753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:20.660266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:20.671495 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6ff28c32-7d25-4ec2-9858-7cb4b29a3ced tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.334572 Aug 31 05:22:20.672699 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 252/499] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:20 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:21.183820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:21.185162 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:21.191608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:21.192309 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:21.192895 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:21.193754 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:21.194461 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:21.195024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:21.360515 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:21.369343 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b7e31488-a8aa-4a09-ad7a-2be15ca2ad31 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.189621 Aug 31 05:22:21.369914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 248/500] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:21 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:21.696487 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:21.697116 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:21.704066 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:21.704553 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:21.704959 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:21.705654 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:21.706145 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:21.706573 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:21.847870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:21.856405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-225b12de-aa19-418b-ac0b-6c84dbdfcaa9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.164066 Aug 31 05:22:21.857359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 253/501] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:21 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:22.392482 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:22.393811 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:22.400940 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:22.401418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:22.401840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:22.402542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:22.403147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:22.403700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:22.577915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:22.585431 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-354422e1-4e72-4b75-a764-ff4ca893b4c6 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.197027 Aug 31 05:22:22.586029 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 249/502] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:22 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:22.877935 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:22.879359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:22.887846 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:22.888787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:22.889446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:22.890385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:22.891019 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:22.891525 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:23.048929 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:23.056902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-47dbc2da-ce0c-49ca-a6dd-01b135e7e942 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.182873 Aug 31 05:22:23.057462 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 254/503] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:22 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:23.607244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:23.607990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:23.609788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:23.615490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:23.615968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:23.616388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:23.617073 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:23.617515 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:23.617950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:23.755710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:23.769356 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2d3e8173-5e89-4d68-9c53-133c569a6e2c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.166154 Aug 31 05:22:23.770068 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 250/504] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:23 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:24.079858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:24.080572 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:24.087630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:24.088119 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:24.088528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:24.089204 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:24.089635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:24.090086 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:24.235356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:24.243606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a708bd1b-6f61-42d9-925e-7a78bcff82ec tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.168921 Aug 31 05:22:24.244166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 255/505] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:24 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:24.791151 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:24.791804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:24.798213 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:24.798691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:24.799273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:24.799927 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:24.800598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:24.801019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:24.943966 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:24.952009 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5bb5cf02-bfaa-4c5c-b3ad-5bd26faf1236 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.164937 Aug 31 05:22:24.952594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 251/506] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:24 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:25.265052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:25.265802 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:25.268443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:25.274265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:25.274746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:25.275166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:25.275928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:25.276368 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:25.276789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:25.434513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:25.455107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-39638677-4f50-490b-b92c-e986e37113b6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.194226 Aug 31 05:22:25.455727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 256/507] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:25 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:25.973091 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:25.973711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:25.980158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:25.980642 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:25.981067 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:25.982128 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:25.982585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:25.982989 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:26.131355 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:26.139519 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2ad9fcee-ef40-463b-b341-ea7533dc7bd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.170450 Aug 31 05:22:26.140477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 252/508] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:25 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:26.477259 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:26.477861 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:26.485613 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:26.486683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:26.486683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:26.487226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:26.487845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:26.488418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:26.643631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:26.653770 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-26c2b485-30c0-4197-8eaa-1ff2ebc35f40 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.180497 Aug 31 05:22:26.666668 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 257/509] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:26 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:27.161225 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:27.161783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:27.168403 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:27.168895 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:27.169313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:27.169999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:27.170559 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:27.170976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:27.325574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:27.334608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3cf8bacc-65be-4b73-9a9e-5bcf5059fe1a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.177308 Aug 31 05:22:27.335244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 253/510] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:27 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:27.677365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:27.677973 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:27.685450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:27.686275 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:27.686715 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:27.687420 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:27.687966 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:27.688271 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:27.834638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:27.842908 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-79c7e400-5e0f-4b55-92ef-ac3d51818cb6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.169987 Aug 31 05:22:27.843774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 258/511] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:27 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:28.356324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:28.357326 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:28.363577 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:28.364050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:28.364476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:28.365144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:28.365579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:28.365988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:28.519209 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:28.529855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6bbabf6d-5d2b-476f-bce6-1febe7b344b0 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.177560 Aug 31 05:22:28.530483 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 254/512] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:28 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:28.867615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:28.868216 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:28.875337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:28.875933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:28.876713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:28.877940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:28.878741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:28.879058 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:29.021995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:29.030827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-39bda56c-5093-46f7-8101-cc631418a32e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.167158 Aug 31 05:22:29.031486 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 259/513] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:28 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:29.551828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:29.552585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:29.561721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:29.562337 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:29.562761 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:29.563468 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:29.564043 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:29.564459 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:30.052471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:30.053114 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:30.060354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:30.061120 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:30.062803 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:30.064025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:30.064633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:30.065173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:30.099713 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:30.113153 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7c36cb3b-05a3-4b93-9880-466b9ab688f7 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.565577 Aug 31 05:22:30.114666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 255/514] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:29 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:30.429118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:30.441869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-35758423-3124-4533-9532-ee6f5ba3aa75 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.393501 Aug 31 05:22:30.444232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 260/515] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:30 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:31.020726 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-2dd5cd58-5476-49a5-9dc0-1e1bd87f0ae8 req-95b4c672-4147-4517-9703-07110be33695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62c43e1-9843-4bb7-addd-98124c4f5425", "tag": "0872e0da-1a2a-452d-a727-7f2804c96031"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:31.033653 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2dd5cd58-5476-49a5-9dc0-1e1bd87f0ae8 req-95b4c672-4147-4517-9703-07110be33695 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:31.034448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2dd5cd58-5476-49a5-9dc0-1e1bd87f0ae8 req-95b4c672-4147-4517-9703-07110be33695 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:31.035053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2dd5cd58-5476-49a5-9dc0-1e1bd87f0ae8 req-95b4c672-4147-4517-9703-07110be33695 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:31.048440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-2dd5cd58-5476-49a5-9dc0-1e1bd87f0ae8 req-95b4c672-4147-4517-9703-07110be33695 service nova] Creating event network-changed:0872e0da-1a2a-452d-a727-7f2804c96031 for instance d62c43e1-9843-4bb7-addd-98124c4f5425 on hv-cinder-85220 Aug 31 05:22:31.053642 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-2dd5cd58-5476-49a5-9dc0-1e1bd87f0ae8 req-95b4c672-4147-4517-9703-07110be33695 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036756 Aug 31 05:22:31.054889 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 256/516] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:22:31.136484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:31.137125 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:31.145310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:31.146185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:31.146675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:31.148518 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:31.148989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:31.149387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:31.322932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:31.330266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0b793a01-a3c6-44e4-b3b8-cfce810a4634 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.199036 Aug 31 05:22:31.330959 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 261/517] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:31 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:31.465418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:31.466490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:31.474663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:31.475503 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:31.475923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:31.476956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:31.477516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:31.478170 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:31.656190 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:31.664817 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-103f315b-5b09-4cfb-baa7-9f94a95d8669 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.204505 Aug 31 05:22:31.665454 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 257/518] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:31 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:32.351340 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:32.351923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:32.359139 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:32.359605 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:32.360023 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:32.360698 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:32.361135 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:32.361545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:32.502295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:32.510427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5f915caf-1e43-4ae4-b899-559438674691 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.162988 Aug 31 05:22:32.517106 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 262/519] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:32 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:32.686038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:32.686723 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:32.693226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:32.693749 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:32.694219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:32.694913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:32.695442 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:32.695915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:32.843775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:32.853599 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-466e76b8-9182-438f-89fb-6176404a322e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.171229 Aug 31 05:22:32.854394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 258/520] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:32 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:33.536734 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:33.537706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:33.547291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:33.547773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:33.548201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:33.548892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:33.549338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:33.549749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:33.695902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:33.703854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-94eee8b1-7403-465e-9782-d76e505551f3 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.173940 Aug 31 05:22:33.704423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 263/521] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:33 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:33.879267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:33.880198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:33.890607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:33.891397 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:33.892092 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:33.893227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:33.893978 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:33.894711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:34.033077 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:34.041784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-36c391cd-0d60-4424-abcb-f2d6dab863ef tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.169295 Aug 31 05:22:34.042403 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 259/522] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:33 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:34.734294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:34.735261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:34.745985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:34.747561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:34.748396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:34.749064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:34.749534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:34.749943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:34.881230 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:34.888978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cf816ddc-deed-4171-9be0-c6318ce44d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.161591 Aug 31 05:22:34.889548 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 264/523] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:34 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:35.064034 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:35.064720 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:35.070761 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:35.071241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:35.071668 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:35.072297 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:35.072776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:35.073193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:35.092030 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:35.216473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:35.226530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ce642489-868b-494d-b7a5-5e5d76264f86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.167608 Aug 31 05:22:35.231792 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 260/524] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:35 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:35.910205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:35.910918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:35.917681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:35.918185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:35.918622 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:35.919314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:35.919751 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:35.920159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:36.068392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:36.079372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8ac2e69e-9700-4ab5-81f9-d69cefc2b59f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.173192 Aug 31 05:22:36.079942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 265/525] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:35 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:36.247923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:36.248608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:36.255147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:36.255630 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:36.256055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:36.256770 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:36.257209 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:36.257619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:36.330835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:36.331223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:36.338076 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:36.338558 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:36.338978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:36.339707 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:36.340152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:36.340557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:36.365342 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-290ce461-26eb-49d7-a682-e3b28e243101 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/ips" status: 200 len: 144 microversion: 2.1 time: 0.038507 Aug 31 05:22:36.366261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 266/526] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:22:36 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:22:36.392571 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:36.400509 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-97462f00-b3a0-4d94-ac5a-845bda5a6153 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.156502 Aug 31 05:22:36.401051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 261/527] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:36 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:37.100475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:37.101203 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:37.107988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:37.108496 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:37.108981 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:37.109676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:37.110138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:37.110538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:37.247231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:37.247696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:37.252421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fa31d09f-19e8-4387-a6df-137c0a96c26b tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.155898 Aug 31 05:22:37.252989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 267/528] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:37 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:37.425430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:37.426452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:37.436352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:37.437127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:37.437824 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:37.438982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:37.439711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:37.440399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:37.573576 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:37.581733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-573a64ad-7b07-4bff-b216-4e62f46a5da4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.162799 Aug 31 05:22:37.582328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 262/529] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:37 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:38.279834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:38.280821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:38.291565 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:38.292350 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:38.293053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:38.294213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:38.294992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:38.295678 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:38.432704 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:38.441880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6419dc02-e677-4d74-b948-341798df7508 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.169136 Aug 31 05:22:38.442509 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 268/530] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:38 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:38.609271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:38.610172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:38.620310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:38.621137 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:38.621844 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:38.623076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:38.623791 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:38.624497 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:38.764337 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:38.773700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c385179f-ff6c-4457-ad38-c483005be5d5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.172627 Aug 31 05:22:38.774327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 263/531] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:38 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:39.462858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:39.463415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:39.471248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:39.471933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:39.472527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:39.473499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:39.474056 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:39.474642 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:39.608942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:39.617117 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a6695a14-9728-4bc7-80bd-197b4625cfeb tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.158218 Aug 31 05:22:39.617708 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 269/532] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:39 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:39.802809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:39.803515 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:39.810671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:39.811230 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:39.811727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:39.812584 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:39.813099 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:39.813581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:39.951855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:39.959932 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-82e50b16-bc80-4549-a997-775132f9e029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.165246 Aug 31 05:22:39.960504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 264/533] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:39 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:40.645194 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:40.646244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:40.652817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:40.653298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:40.653723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:40.654439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:40.654881 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:40.655294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:40.792774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:40.807184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3c6969e6-f371-4368-a01a-85ab4f7e52f5 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.165835 Aug 31 05:22:40.807977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 270/534] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:40 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:40.984730 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:40.985567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:40.995819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:40.996601 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:40.997303 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:40.998482 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:40.999216 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:40.999813 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:41.135279 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:41.143321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-03010be5-39ac-430c-8900-bdbc8c952b2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.165518 Aug 31 05:22:41.143891 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 265/535] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:40 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:41.832697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:41.833657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:41.844391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:41.845165 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:41.845854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:41.847003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:41.847735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:41.848415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:41.984575 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:41.992445 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7a0e98e0-5f09-4450-ab9c-b29f6ca7d850 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.166469 Aug 31 05:22:41.993009 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 271/536] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:41 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:42.169181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:42.170080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:42.180418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:42.181215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:42.181910 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:42.183064 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:42.183797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:42.184470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:42.320769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:42.331532 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3c5caa16-7600-4ed2-9983-c85df7936911 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.169063 Aug 31 05:22:42.332150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 266/537] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:42 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:43.012707 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:43.013231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:43.019909 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:43.020380 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:43.020799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:43.021467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:43.021902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:43.022356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:43.152641 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:43.161035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7637b235-e6fb-4595-8e09-04600ff70776 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.152283 Aug 31 05:22:43.161628 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 272/538] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:43 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:43.359492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:43.360093 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:43.366608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:43.367089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:43.367510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:43.368184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:43.368624 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:43.369038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:43.499255 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:43.508148 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bfbdf0e6-a9a6-4f61-b9d4-e8364f08c680 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.155018 Aug 31 05:22:43.508726 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 267/539] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:43 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:43.662796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd42074e-5d05-4a5f-9963-07f0de637d10"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:43.665288 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:43.671907 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:43.672387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:43.672813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:43.673495 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:43.673940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:43.674382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:43.971207 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6ebfb3d3-e836-4263-83d4-89c2c803e0fa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314323 Aug 31 05:22:43.972928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 273/540] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:22:43 2022] POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:22:44.064799 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-f52d03f8-798b-406a-bf5d-8b5eb5a84049 req-94fa9f8d-8d10-424e-a6e2-4a8594dd0a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62c43e1-9843-4bb7-addd-98124c4f5425", "name": "network-vif-plugged", "status": "completed", "tag": "0872e0da-1a2a-452d-a727-7f2804c96031"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:44.077495 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f52d03f8-798b-406a-bf5d-8b5eb5a84049 req-94fa9f8d-8d10-424e-a6e2-4a8594dd0a99 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:44.078173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f52d03f8-798b-406a-bf5d-8b5eb5a84049 req-94fa9f8d-8d10-424e-a6e2-4a8594dd0a99 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:44.078693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f52d03f8-798b-406a-bf5d-8b5eb5a84049 req-94fa9f8d-8d10-424e-a6e2-4a8594dd0a99 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:44.091310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-f52d03f8-798b-406a-bf5d-8b5eb5a84049 req-94fa9f8d-8d10-424e-a6e2-4a8594dd0a99 service nova] Creating event network-vif-plugged:0872e0da-1a2a-452d-a727-7f2804c96031 for instance d62c43e1-9843-4bb7-addd-98124c4f5425 on hv-cinder-85220 Aug 31 05:22:44.096556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-f52d03f8-798b-406a-bf5d-8b5eb5a84049 req-94fa9f8d-8d10-424e-a6e2-4a8594dd0a99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037150 Aug 31 05:22:44.097583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 268/541] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:22:44.184007 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:44.184529 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:44.192253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:44.192746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:44.193173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:44.193863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:44.194339 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:44.194757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:44.340944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:44.350762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-13187271-037c-4ae1-add2-50abaf3715ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.171927 Aug 31 05:22:44.351428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 274/542] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:44 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:44.529579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:44.530329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:44.537054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:44.537559 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:44.537980 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:44.538695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:44.539142 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:44.539550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:44.686789 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:44.695925 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-abd24fe5-27a2-4102-bd7e-9db6002ee867 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.170670 Aug 31 05:22:44.696487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 269/543] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:44 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:45.196251 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:45.196880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:45.203603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:45.204077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:45.204502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:45.205176 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:45.205615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:45.206042 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:45.231650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1d1987df-ada2-48c1-9c1c-6c0d25653b8b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/ips" status: 200 len: 152 microversion: 2.20 time: 0.039078 Aug 31 05:22:45.232341 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 275/544] 10.222.0.36 () {60 vars in 1289 bytes} [Wed Aug 31 05:22:45 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:22:45.372681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:45.373267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:45.379457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:45.379921 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:45.380369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:45.381028 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:45.381426 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:45.381851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:45.520742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:45.532015 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c50b7408-f5fd-4d87-8fd9-80db14593964 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.163052 Aug 31 05:22:45.546256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 270/545] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:45 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:45.717106 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:45.717707 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:45.724610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:45.725071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:45.725487 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:45.726201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:45.726646 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:45.727083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:45.865208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:45.876123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3ccefd11-4c97-4a55-9193-4cbbfc7d8444 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.162612 Aug 31 05:22:45.876724 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 276/546] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:45 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:46.553433 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:46.554296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:46.561296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:46.561812 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:46.562295 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:46.563184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:46.563628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:46.564184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:46.718754 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:46.728049 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8874d517-3d9e-4581-bd2c-293d99732941 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1358 microversion: 2.1 time: 0.179053 Aug 31 05:22:46.734280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 271/547] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:46 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:46.896789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:46.897523 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:46.904524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:46.905005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:46.905511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:46.906236 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:46.906686 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:46.907099 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:47.045710 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:47.053590 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-06737c74-01ed-4c80-8318-06e1dd4cd637 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.160718 Aug 31 05:22:47.054201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 277/548] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:46 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:47.752923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:47.753608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:47.761584 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:47.762244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:47.762832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:47.763679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:47.764242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:47.764862 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:47.893549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:47.901784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6afbd107-8e6e-43fe-bfa8-48b18c396792 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1547 microversion: 2.1 time: 0.154040 Aug 31 05:22:47.902725 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 272/549] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:47 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:47.922816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:47.923390 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:47.929788 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:47.930290 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:47.930713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:47.931387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:47.931826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:47.932264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.074652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:48.074810 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:48.075249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:48.081514 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.081990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.082448 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.082967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e464aa90-6218-4229-82f5-3743081a4515 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1547 microversion: 2.1 time: 0.164089 Aug 31 05:22:48.083105 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.083548 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 278/550] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:47 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:48.083656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.088510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.102570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:48.107995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:48.108859 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Searching by: {'deleted': False, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505'} {{(pid=120607) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 05:22:48.115650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.116118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.116538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.117244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.117685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.118120 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.210907 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.multi_cell_list [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120607) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 05:22:48.219122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:48.227125 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-abcf2482-3079-4795-8a02-f91830724c6b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.156349 Aug 31 05:22:48.227706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 273/551] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:48 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:48.233105 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:48.233627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:48.239403 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.239867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.240282 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.240946 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.241377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.241777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.264468 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lazy-loading 'flavor' on Instance uuid 5b209be4-6027-4328-a956-5deea7de1a64 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:22:48.319507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-42d06e76-7134-49cd-963c-264e0de3672f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.220502 Aug 31 05:22:48.320104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 279/552] 10.222.0.36 () {58 vars in 1125 bytes} [Wed Aug 31 05:22:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:22:48.331965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:48.332537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:48.338490 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.338961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.339380 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.340048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.340623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.341122 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.443604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0cd69e04-c52e-4573-a6a4-6ad205fb12eb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/action" status: 202 len: 0 microversion: 2.20 time: 0.214251 Aug 31 05:22:48.444847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 274/553] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Aug 31 05:22:48 2022] POST /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:22:48.453851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:48.454634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:48.461090 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.461643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.462200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.462885 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:48.463322 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:48.463735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:48.477384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:48.487233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a6cdd57f-907b-44a8-8c85-4392ae43d9e2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1547 microversion: 2.1 time: 0.159111 Aug 31 05:22:48.487824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 280/554] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:48 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:48.595199 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:48.598759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:48.604080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:48.605536 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:48.607178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d0be7dce-31de-4724-8705-04ed95079c6d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.157508 Aug 31 05:22:48.607739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 275/555] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:48 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:22:49.254313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:49.255322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:49.265956 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:49.266487 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:49.266929 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:49.267597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:49.268031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:49.268436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:49.396731 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:49.404479 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-054adcf8-1a32-4e5a-bad7-7983ed0692c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.156488 Aug 31 05:22:49.405042 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 281/556] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:49 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:49.632937 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:49.633717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:49.642954 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:49.643424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:49.643850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:49.644526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:49.644959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:49.645362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:49.779605 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:49.788196 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:49.789608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:49.790816 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-622f552f-0c90-49d8-93cb-ec88fa20638c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.164324 Aug 31 05:22:49.791377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 276/557] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:49 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:50.424812 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:50.425569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:50.432184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:50.432660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:50.433078 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:50.433746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:50.434213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:50.434624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:50.812986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:50.814350 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:50.820792 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:50.821382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:50.821839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:50.822560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:50.823047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:50.823541 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:50.853408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:50.861700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-829122f3-6d57-489b-b295-386484cc80fc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.440846 Aug 31 05:22:50.862310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 282/558] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:50 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:50.956166 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:50.964439 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:50.965913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:50.967098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-726fcb79-eaa5-41d4-8336-da25300c262c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.158128 Aug 31 05:22:50.967655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 277/559] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:50 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:51.092772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f497df74-d325-4369-be25-86818ae7b6fb"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:51.095176 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:51.101183 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:51.101649 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:51.102092 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:51.102757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:51.103187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:51.103647 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:51.107651 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:51.884324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:51.885208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:51.892654 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:51.893131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:51.893553 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:51.894255 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:51.894696 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:51.895099 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:52.105574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:52.113579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-780791ed-4177-407e-8643-9b1906c5078d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.234405 Aug 31 05:22:52.114196 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 278/560] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:51 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:52.118533 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:52.119114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:52.125065 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:52.125564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:52.125958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:52.126664 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:52.127097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:52.127501 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:52.257622 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:52.266450 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:52.267940 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:52.269071 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bff08aa0-bee9-4260-8531-6630f75324a7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.154012 Aug 31 05:22:52.269632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 279/561] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:52 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:53.125354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6aca4b52-2246-4948-b75b-e7a429d4d9ce tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "POST /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.036422 Aug 31 05:22:53.129102 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 283/562] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:22:51 2022] POST /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments => generated 194 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:22:53.134635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:53.135218 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:53.141870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:53.142490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:53.142972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:53.143768 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:53.144254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:53.144753 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:53.273355 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:53.281332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ed5af858-917f-4458-92f1-33240e11fba5 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.150604 Aug 31 05:22:53.281898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 280/563] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:53 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:53.296016 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:53.296807 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:53.303266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:53.303734 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:53.304153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:53.304822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:53.305259 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:53.305660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:53.443363 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:53.451972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:53.453375 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:53.454548 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-768e38f2-b7c8-4d11-bbc8-b57026b71ee7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.163250 Aug 31 05:22:53.455214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 284/564] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:53 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:54.301892 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:54.302526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:54.304443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=62 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:54.310108 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.310627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.311055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.311788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.312266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.312679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.461812 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:54.470379 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4873953e-4a4c-43c7-8d21-4ac4688fd6a6 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1500 microversion: 2.1 time: 0.172319 Aug 31 05:22:54.470973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 281/565] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:54 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1500 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:54.477458 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:54.478087 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:54.488638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.489189 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.489768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.490483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.490921 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.491329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.497134 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3abab21b-30f2-4afa-a7c0-3311a3dab855"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:54.500055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:54.507364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.507847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.508271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.509088 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.509892 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.510734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.536547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] HTTP exception thrown: Cannot 'attach_volume' instance b72dc747-3be8-4092-b09d-1d6943280b33 while it is in vm_state rescued Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Request method failure captured: Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33/os-volume_attachments HTTP/1.1 Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 74 Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu-pXJKIoDquy7frIjf6367HIYV4ywuMw9eIzUQ6pzxxOdOscxvrbuNl8dNXf_pCV50S3c0EluZ2OXqtHTC_CSyU5WlJJy0Euo8B4JbRS7RkLLOWn5LU7NuhHi-jr4y8w6V2MalJ01NkQGCIFlhDqekMGoOhFD-_toDGqryfBR34-4A Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 597fddc7874a4133987f79807674561f Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:22:54.538378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_597fddc7874a4133987f79807674561f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/597fddc7874a4133987f79807674561f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 597fddc7874a4133987f79807674561f Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 806b011517ef4201a86c90472e0740d6 Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {"volumeAttachment": {"volumeId": "3abab21b-30f2-4afa-a7c0-3311a3dab855"}} Aug 31 05:22:54.540085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Cannot 'attach_volume' instance b72dc747-3be8-4092-b09d-1d6943280b33 while it is in vm_state rescued Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'server_id': 'b72dc747-3be8-4092-b09d-1d6943280b33', 'body': {'volumeAttachment': {'volumeId': '3abab21b-30f2-4afa-a7c0-3311a3dab855'}}} Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b72dc747-3be8-4092-b09d-1d6943280b33 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:22:54.540992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b72dc747-3be8-4092-b09d-1d6943280b33 while it is in vm_state rescued Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:22:54.542487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:22:54.543819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:22:54.543819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:22:54.543819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b72dc747-3be8-4092-b09d-1d6943280b33 while it is in vm_state rescued Aug 31 05:22:54.543819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:22:54.543819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Returning 409 to user: Cannot 'attach_volume' instance b72dc747-3be8-4092-b09d-1d6943280b33 while it is in vm_state rescued {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:22:54.543819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3d6cc739-5f5d-426f-95c2-95197e1f6fbf tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048031 Aug 31 05:22:54.543819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 282/566] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:22:54 2022] POST /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 05:22:54.553765 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:54.554326 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:54.560560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.561005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.561430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.562182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.562673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.563083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.636237 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:54.647656 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:54.649434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:54.651304 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2038774b-bda6-4cf9-9953-f9757b166c96 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.177998 Aug 31 05:22:54.652189 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 285/567] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:54 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:54.655822 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e484a49a-085c-4823-918c-8042422d82a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33/action" status: 202 len: 0 microversion: 2.1 time: 0.105701 Aug 31 05:22:54.659622 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 283/568] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:22:54 2022] POST /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 05:22:54.664751 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:54.665433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:54.671993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.672527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.673013 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.673797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.674334 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.674808 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.742127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d00b759a-f386-498a-aa32-4597f93e80cc tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:22:54.748504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d00b759a-f386-498a-aa32-4597f93e80cc tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.748986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d00b759a-f386-498a-aa32-4597f93e80cc tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.749597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d00b759a-f386-498a-aa32-4597f93e80cc tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.806403 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:54.812006 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d00b759a-f386-498a-aa32-4597f93e80cc tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Going to try to stop instance {{(pid=120608) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 05:22:54.814400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b87699f2-0bf4-4118-896c-fbc5420271f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.153567 Aug 31 05:22:54.814993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 286/569] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:54 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:54.857594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d00b759a-f386-498a-aa32-4597f93e80cc tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/action" status: 202 len: 0 microversion: 2.1 time: 0.119993 Aug 31 05:22:54.858225 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 284/570] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:22:54 2022] POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:22:54.866661 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:54.867198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:54.873522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.873985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.874540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:54.875188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:54.875642 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:54.876028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:55.018735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:55.027270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d06688b8-2d06-4d98-bc7b-7e525a3fceb7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.164587 Aug 31 05:22:55.027852 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 287/571] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:54 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:55.674884 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:55.675563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:55.681969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:55.682500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:55.682928 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:55.683612 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:55.684060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:55.684476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:55.825426 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:55.836750 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:55.838438 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:55.838960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:55.840062 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:55.841255 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-007bcaa8-8842-4807-91d7-84b547b4cf50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.170681 Aug 31 05:22:55.841687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=64 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:55.841806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 285/572] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:55 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:55.848224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:55.848833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:55.849262 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:55.849945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:55.850478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:55.850916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:55.987417 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:55.999304 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4bb6ea1c-a1d7-4344-925b-7be32adf2cb7 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.166918 Aug 31 05:22:55.999900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 288/573] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:55 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:56.051747 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:56.052780 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:56.063268 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:56.064077 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:56.064771 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:56.065936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:56.066724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:56.067425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:56.209539 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:56.222164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cd72672b-6f08-471b-8a69-bb42641eebb4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.176837 Aug 31 05:22:56.222959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 286/574] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:56 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:56.865600 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:56.866266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:56.874746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:56.875332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:56.875918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:56.876907 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:56.877417 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:56.877893 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:57.020325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:57.023169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:57.027024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:57.031634 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:57.033199 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:57.033337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:57.033679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:57.034126 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:57.034604 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-81db50b4-f1a3-4754-93b8-0f47cec330a6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.173290 Aug 31 05:22:57.035156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:57.035285 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 289/575] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:56 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:57.035877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:57.036296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:57.172544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:57.181032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1ac13824-7cc7-4976-aa8a-604cc31fbd2b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.164563 Aug 31 05:22:57.181598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 287/576] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:57 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:57.247917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:57.248516 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:57.255119 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:57.255599 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:57.256032 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:57.256705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:57.257144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:57.257553 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:57.391672 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:57.399923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-027f8aa6-b4d9-4873-92f3-ce4b8f97540e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.155954 Aug 31 05:22:57.400485 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 290/577] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:57 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:58.063373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:58.064153 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:58.071469 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:58.072029 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:58.072525 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:58.073304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:58.073825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:58.074337 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:58.202841 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:58.203438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:58.205798 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:58.211643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:58.211819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:58.212126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:58.212555 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:58.213245 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:58.213676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:58.214357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:58.220126 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:58.221554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:58.222788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8f516166-3b84-493f-9856-7776103c6e0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.165698 Aug 31 05:22:58.223389 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 288/578] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:58 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:58.363205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:58.372829 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b55f5f7a-c0bf-461f-892f-db571e116f72 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.173929 Aug 31 05:22:58.373398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 291/579] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:58 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:58.420781 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:58.421411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:58.427834 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:58.428302 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:58.428722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:58.429642 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:58.429779 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:58.430224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:58.567538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:58.579941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-92fb31bf-ed07-4b0c-8671-283d24bc158f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.162986 Aug 31 05:22:58.580514 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 289/580] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:58 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:22:59.246211 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:59.246804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:59.253709 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:59.254237 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:59.254660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:59.255326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:59.255767 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:59.256175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:59.390453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:59.399070 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:59.399295 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:59.399783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:59.400491 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:59.401649 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d24305eb-ab42-42b4-882b-74514bd0a194 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.159414 Aug 31 05:22:59.402244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 292/581] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:22:59 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:22:59.406152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:59.406625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:59.407052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:59.407725 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:59.408166 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:59.408574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:59.540944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:59.544732 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:59.550150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-29354fd4-50d7-4b83-af5d-7b0862a7b858 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.154544 Aug 31 05:22:59.550865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 290/582] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:59 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:22:59.601880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:22:59.602545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:22:59.609024 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:59.609491 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:59.609944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:59.610631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:22:59.611068 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:22:59.611471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:22:59.747300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:22:59.760887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7e0c03d2-4999-458b-810d-b57b3f6f0c36 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.162768 Aug 31 05:22:59.761765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 293/583] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:22:59 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:00.429698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:00.430646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:00.440147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:00.440616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:00.441038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:00.441705 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:00.442179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:00.442591 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:00.570411 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:00.571911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:00.573222 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:00.579006 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:00.579598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:00.580123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:00.580922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:00.581471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:00.581950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:00.583289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:00.584900 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:00.586352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d29cc6b2-da82-463d-adac-72908ea7facd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.163724 Aug 31 05:23:00.598204 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 291/584] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:00 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:00.721144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:00.729077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1f7fda4e-4a0d-410f-b435-697a7e074732 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.162481 Aug 31 05:23:00.729679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 294/585] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:00 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:00.786735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:00.787836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:00.796877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:00.797627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:00.798050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:00.798738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:00.799175 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:00.799582 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:00.932051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:00.940795 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5b657df2-234f-4da4-b900-f4be581e7c9c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.160550 Aug 31 05:23:00.941360 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 292/586] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:00 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:01.616422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:01.617436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:01.627325 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:01.627796 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:01.628194 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:01.628877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:01.629316 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:01.629715 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:01.750263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:01.750973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:01.757131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:01.757608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:01.758065 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:01.758738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:01.759225 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:01.759580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:01.761825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:01.770181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:01.771591 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:01.772728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2b96b340-dcca-42b7-a711-ab4a2e7da0e8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.162961 Aug 31 05:23:01.773253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 295/587] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:01 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:01.888739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:01.897001 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0d617644-f008-4b98-9edf-dc327f1c7f49 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.150585 Aug 31 05:23:01.897560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 293/588] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:01 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:01.965005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:01.965893 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:01.973343 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:01.973815 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:01.974270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:01.974943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:01.975379 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:01.975786 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:02.105408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:02.114712 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f7a7ffdc-c58b-44b5-a74b-ab94a529d213 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.155520 Aug 31 05:23:02.115276 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 296/589] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:01 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:02.798735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:02.799287 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:02.806691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:02.807198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:02.807660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:02.808381 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:02.808869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:02.809420 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:02.917961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:02.918557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:02.925406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:02.925908 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:02.926342 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:02.927021 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:02.927463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:02.927865 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:02.954265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:02.962684 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:02.964089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:02.965213 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ba95be8f-67d5-42d2-b310-351fbe6542f9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.173206 Aug 31 05:23:02.965770 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 294/590] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:02 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:03.056842 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:03.065620 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-de4243a5-646d-4028-aa9e-f6f58fd56f3e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.151521 Aug 31 05:23:03.066218 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 297/591] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:02 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:03.139538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:03.140502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:03.150631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:03.151437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:03.152140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:03.153237 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:03.153968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:03.154692 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:03.299260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:03.307864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-858e9b69-fc01-4a2f-a79f-9a207f446ea2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.174763 Aug 31 05:23:03.308357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 295/592] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:03 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:03.991941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:03.992792 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:04.003170 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:04.003645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:04.004074 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:04.004748 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:04.005186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:04.005589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:04.023526 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:04.086949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:04.087545 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:04.093944 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:04.094481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:04.094889 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:04.095685 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:04.096132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:04.096537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:04.147956 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:04.156078 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:04.157507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:04.158737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bb3b9488-07aa-4bac-8905-77a07e9d7378 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.173439 Aug 31 05:23:04.159308 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 298/593] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:03 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:04.235683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:04.243909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e6e6ae3c-19e9-45b5-9e43-d00fbdfe1396 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.161000 Aug 31 05:23:04.244477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 296/594] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:04 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:04.331790 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:04.332393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:04.339195 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:04.339699 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:04.340176 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:04.340879 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:04.341323 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:04.341736 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:04.488471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:04.496934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c5f18fa6-9614-43a9-98cc-522f09f55392 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.170591 Aug 31 05:23:04.497432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 299/595] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:04 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:05.185272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:05.186194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:05.196487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:05.197279 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:05.198274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:05.199143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:05.199881 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:05.200567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:05.265035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:05.265695 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:05.273008 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:05.273571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:05.274099 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:05.274843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:05.275352 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:05.275852 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:05.364072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:05.373638 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:05.375600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:05.377129 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-15e84a9a-5f29-47e9-8f6a-1c5debab84ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.198687 Aug 31 05:23:05.377778 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 297/596] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:05 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:05.426797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:05.434455 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2aa4a962-2be0-4e13-b8f2-30e2c57259c9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.173317 Aug 31 05:23:05.435027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 300/597] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:05 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:05.517717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:05.518373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:05.524394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:05.524985 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:05.525310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:05.525983 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:05.526564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:05.526974 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:05.659400 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:05.667722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9b7b32d1-8938-4df2-a209-479284b3e3bd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.153841 Aug 31 05:23:05.668283 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 298/598] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:05 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:06.404123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:06.405117 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:06.412972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:06.413440 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:06.413857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:06.414556 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:06.414990 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:06.415396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:06.457122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:06.457728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:06.463839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:06.464317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:06.464742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:06.465425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:06.465864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:06.466304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:06.595451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:06.612297 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:06.614208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:06.616884 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4558abe2-bf18-4e3d-97a3-05943c418a9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.219242 Aug 31 05:23:06.626974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 301/599] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:06 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:06.647819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:06.661671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c429407e-1a44-4435-b1bb-59414f8bb5a0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.208875 Aug 31 05:23:06.662529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 299/600] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:06 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:23:06.688697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:06.689507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:06.695589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:06.696308 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:06.696937 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:06.697812 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:06.698425 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:06.699154 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:06.875430 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:06.884430 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-88562d41-ac48-4bf1-9a19-d6672df3958f tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.199478 Aug 31 05:23:06.885140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 302/601] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:06 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:07.132181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:07.132776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:07.138820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:07.139295 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:07.139717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:07.140391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:07.140827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:07.141236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:07.285975 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:07.294424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a8f0c6da-c758-4c13-b73b-e785d2f373af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1593 microversion: 2.1 time: 0.166059 Aug 31 05:23:07.294995 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 300/602] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:07 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1593 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:07.641282 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:07.641899 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:07.648857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:07.649351 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:07.649760 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:07.650515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:07.650938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:07.651426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:07.682811 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:07.683430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:07.689519 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:07.689996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:07.690473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:07.691154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:07.691600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:07.692009 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:08.177880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:08.183225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:08.186133 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b32ad678-c335-41c5-934f-d320a1ee5089 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.507250 Aug 31 05:23:08.186759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 301/603] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:07 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:23:08.191563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:08.192449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:08.198775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:08.199470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:08.200127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:08.201022 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:08.202338 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:08.203332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:08.207751 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:08.209250 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:08.211441 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bab283e2-109a-4c8c-a007-657e5ddf6d45 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1743 microversion: 2.20 time: 0.574398 Aug 31 05:23:08.212395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 303/604] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:07 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1743 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:08.409628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:08.418334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-27b9c881-e279-4fd5-8187-9465022eed66 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.230338 Aug 31 05:23:08.418906 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 302/605] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:08 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:09.211134 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:09.211821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:09.226026 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:09.226672 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:09.227351 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:09.229426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:09.229426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:09.229426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:09.234900 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:09.235488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:09.242150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:09.242655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:09.243123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:09.243789 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:09.244410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:09.244982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:09.506233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:09.514329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-89a830c6-21ff-4619-8696-4a3ba0520971 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.307967 Aug 31 05:23:09.514922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 304/606] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:09 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:09.523618 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:09.533091 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:09.533325 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:09.533690 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:09.534729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:09.537311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ae771d31-79b1-417a-bb0f-83f4de168c1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1743 microversion: 2.20 time: 0.306279 Aug 31 05:23:09.537980 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 303/607] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:09 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1743 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:23:09.553785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:09.554336 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:09.554763 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:09.555465 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:09.555907 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:09.556313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:09.753395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:09.760038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-b4b879d3-4463-4167-9b4f-b34a80b8526d req-97ad1f71-d346-4261-a698-9304a5a3b452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62c43e1-9843-4bb7-addd-98124c4f5425", "tag": "0872e0da-1a2a-452d-a727-7f2804c96031"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:09.769941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-b4b879d3-4463-4167-9b4f-b34a80b8526d req-97ad1f71-d346-4261-a698-9304a5a3b452 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:09.769941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-b4b879d3-4463-4167-9b4f-b34a80b8526d req-97ad1f71-d346-4261-a698-9304a5a3b452 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:09.770343 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-b4b879d3-4463-4167-9b4f-b34a80b8526d req-97ad1f71-d346-4261-a698-9304a5a3b452 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:09.776806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-93d66d89-8db7-4259-987e-87346e6cd6ad tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.247394 Aug 31 05:23:09.781541 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-b4b879d3-4463-4167-9b4f-b34a80b8526d req-97ad1f71-d346-4261-a698-9304a5a3b452 service nova] Creating event network-changed:0872e0da-1a2a-452d-a727-7f2804c96031 for instance d62c43e1-9843-4bb7-addd-98124c4f5425 on hv-cinder-85220 Aug 31 05:23:09.781728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 305/608] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:09 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:09.787628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-b4b879d3-4463-4167-9b4f-b34a80b8526d req-97ad1f71-d346-4261-a698-9304a5a3b452 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Aug 31 05:23:09.791135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 304/609] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:23:10.535350 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:10.536681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:10.544699 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:10.545560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:10.546442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:10.547501 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:10.548155 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:10.549118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:10.563491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:10.564321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:10.578855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:10.579444 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:10.579959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:10.580719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:10.581630 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:10.581905 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:10.867043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:10.876037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e9977fe1-fa69-49c3-afd1-77a9b2d70bd9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1508 microversion: 2.1 time: 0.344683 Aug 31 05:23:10.877066 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 306/610] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:10 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:10.889299 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:10.889904 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:10.897948 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:10.898675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:10.899277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:10.900122 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:10.900758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:10.901395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:10.946105 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:10.954307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:10.955867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:10.957273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-908dd569-b326-48f0-98f5-00a2ae4ccfe4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1743 microversion: 2.20 time: 0.399166 Aug 31 05:23:10.958358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 305/611] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:10 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1743 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:10.964644 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-606755977"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:10.965400 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:10.971993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:10.972746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:10.973171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:10.973851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:10.974608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:10.974725 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:11.167494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:11.177031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5c7fa057-9839-4de3-bd40-8ea4b92fb61c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.298887 Aug 31 05:23:11.177980 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 307/612] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:10 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:11.279331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.network.security_group_api [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Adding security group 280b8ce2-f18c-4768-9916-73a03ec4e1d4 to port 0872e0da-1a2a-452d-a727-7f2804c96031 Aug 31 05:23:11.789920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-97ecac18-1225-44e8-ab7a-674bf85b0eff tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "POST /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/action" status: 202 len: 0 microversion: 2.1 time: 0.830288 Aug 31 05:23:11.790581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 306/613] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:23:10 2022] POST /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:23:11.799038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:11.799661 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:11.806277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:11.806746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:11.807164 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:11.808145 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:11.808754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:11.809162 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:11.819272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-2134c34e-a17e-4928-b177-9611e79f2342 req-f12b2547-a67d-4898-aa0c-1fd990de3106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62c43e1-9843-4bb7-addd-98124c4f5425", "tag": "0872e0da-1a2a-452d-a727-7f2804c96031"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:11.829436 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2134c34e-a17e-4928-b177-9611e79f2342 req-f12b2547-a67d-4898-aa0c-1fd990de3106 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:11.830280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2134c34e-a17e-4928-b177-9611e79f2342 req-f12b2547-a67d-4898-aa0c-1fd990de3106 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:11.830857 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2134c34e-a17e-4928-b177-9611e79f2342 req-f12b2547-a67d-4898-aa0c-1fd990de3106 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:11.843373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-2134c34e-a17e-4928-b177-9611e79f2342 req-f12b2547-a67d-4898-aa0c-1fd990de3106 service nova] Creating event network-changed:0872e0da-1a2a-452d-a727-7f2804c96031 for instance d62c43e1-9843-4bb7-addd-98124c4f5425 on hv-cinder-85220 Aug 31 05:23:11.858793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-2134c34e-a17e-4928-b177-9611e79f2342 req-f12b2547-a67d-4898-aa0c-1fd990de3106 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044318 Aug 31 05:23:11.859736 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 307/614] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:23:11.901747 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:11.902729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:11.909319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:11.910357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:11.911033 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:11.911966 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:11.912621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:11.913250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:12.031878 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:12.053985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5b1a5656-ed41-4ea6-aeb6-a2e5e8a1c978 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1757 microversion: 2.1 time: 0.258782 Aug 31 05:23:12.054903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 308/615] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:11 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1757 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:12.060315 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:12.061448 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:12.069984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:12.071721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:12.072780 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:12.073727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:12.074579 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:12.075169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:12.441408 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:12.451598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2b42b8d9-8f86-4180-aa47-a6e564caf4c4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1514 microversion: 2.1 time: 0.554142 Aug 31 05:23:12.452167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 308/616] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:11 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1514 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:23:12.460157 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:12.461537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:12.481237 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:12.481953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:12.483131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:12.484193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:12.484798 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:12.485366 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:12.491919 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=100 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:12.544949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:12.562265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:12.564356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:12.565974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5ec93043-19c7-417a-9099-ffe6154c588a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1743 microversion: 2.20 time: 0.509580 Aug 31 05:23:12.566843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 309/617] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:12 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1743 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:12.585622 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-db0f1298-a3eb-478d-937f-23d040b024a6 req-321da30e-ae42-4a0c-9f10-79b970b0130a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b209be4-6027-4328-a956-5deea7de1a64", "name": "network-vif-plugged", "status": "completed", "tag": "918fbec4-f9a6-4f49-98c8-ddb91a52e37a"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:12.596766 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-db0f1298-a3eb-478d-937f-23d040b024a6 req-321da30e-ae42-4a0c-9f10-79b970b0130a service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:12.597022 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-db0f1298-a3eb-478d-937f-23d040b024a6 req-321da30e-ae42-4a0c-9f10-79b970b0130a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:12.597432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-db0f1298-a3eb-478d-937f-23d040b024a6 req-321da30e-ae42-4a0c-9f10-79b970b0130a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:12.612080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-db0f1298-a3eb-478d-937f-23d040b024a6 req-321da30e-ae42-4a0c-9f10-79b970b0130a service nova] Creating event network-vif-plugged:918fbec4-f9a6-4f49-98c8-ddb91a52e37a for instance 5b209be4-6027-4328-a956-5deea7de1a64 on hv-cinder-85220 Aug 31 05:23:12.618073 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-db0f1298-a3eb-478d-937f-23d040b024a6 req-321da30e-ae42-4a0c-9f10-79b970b0130a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036897 Aug 31 05:23:12.618922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 310/618] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:23:12.724628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:12.734484 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bb9543d6-e662-4f5a-9897-a10cfb7b90bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.280406 Aug 31 05:23:12.735349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 309/619] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:12 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:13.595521 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:13.596679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:13.603891 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:13.604365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:13.604787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:13.605852 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:13.606326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:13.606733 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:13.743277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:13.751759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:13.753150 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:13.754401 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5397389c-6705-468f-b880-21e3ee03a47a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1743 microversion: 2.20 time: 0.167123 Aug 31 05:23:13.754960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 311/620] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:13 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:13.756923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:13.757512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:13.763729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:13.764183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:13.764597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:13.765260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:13.765698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:13.766132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:13.892162 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a8efb995-f8e0-4446-b827-7df65b74452c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'create', calling method: .version_select at 0x7fbd0b29fb80>, body: {"keypair": {"name": "tempest-keypair-2043437905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOtrKie/NXbAsGV/O8XVQWGYeXN8gcKgRNiDtGYoQ3S1uc8MVpDxm9azBdr+ulRu4RXL/ECW9LdPMHOOkpvp4nSvTXCKE6nFsVy/1VLNOfUEXnGJuobC2lorf4xIZE96A=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:13.906934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:13.907428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-a8efb995-f8e0-4446-b827-7df65b74452c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Getting quotas for project 597fddc7874a4133987f79807674561f. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:23:13.911451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-a8efb995-f8e0-4446-b827-7df65b74452c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Getting quotas for user 806b011517ef4201a86c90472e0740d6 and project 597fddc7874a4133987f79807674561f. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:23:13.915101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-678d2651-8df9-4c71-a549-45d6222ff7d3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.162116 Aug 31 05:23:13.915634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 310/621] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:13 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:13.934716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a8efb995-f8e0-4446-b827-7df65b74452c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046303 Aug 31 05:23:13.935334 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 312/622] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:23:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:23:14.780228 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:14.780986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:14.788513 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:14.789017 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:14.789527 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:14.790305 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:14.791119 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:14.791741 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:14.938958 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:14.941737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:14.952514 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:14.953395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:14.954140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:14.954992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:14.955631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:14.956511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:15.002234 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:15.011235 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:15.013063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:15.014518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2a67ad22-fd68-4295-a236-896e0b854268 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.238805 Aug 31 05:23:15.030322 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 311/623] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:14 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:15.210019 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:15.219373 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3533da37-0adf-4b34-9cf1-0b0e5d2fc691 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.286388 Aug 31 05:23:15.236958 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 313/624] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:14 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:15.505106 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-116120510", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "991f8f30-a46a-43d2-914e-94c76b2ab494"}], "security_groups": [{"name": "tempest-securitygroup--234451733"}], "key_name": "tempest-keypair-2043437905", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:15.621644 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] validate_networks() for [('991f8f30-a46a-43d2-914e-94c76b2ab494', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:23:16.041003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:16.041586 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:16.049908 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:16.050956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:23:16.051641 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:23:16.051774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:16.052230 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:23:16.052469 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:23:16.052686 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:23:16.053677 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:16.054972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:16.055735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:16.056545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:16.062688 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:16.063132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:16.063636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:16.064557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:16.064985 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:16.065406 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:16.085271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Getting quotas for project 597fddc7874a4133987f79807674561f. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:23:16.089402 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Getting quotas for user 806b011517ef4201a86c90472e0740d6 and project 597fddc7874a4133987f79807674561f. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:23:16.101339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:23:16.103667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:23:16.182358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ef664b17-a461-411a-b51b-d12efd9cf439 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.681391 Aug 31 05:23:16.183566 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 312/625] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:23:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 05:23:16.194248 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8f625bdd-b7b6-40a1-8ae6-6b9f3f65b6cb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:16.198373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8f625bdd-b7b6-40a1-8ae6-6b9f3f65b6cb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:16.298458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8f625bdd-b7b6-40a1-8ae6-6b9f3f65b6cb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:16.310706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8f625bdd-b7b6-40a1-8ae6-6b9f3f65b6cb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1245 microversion: 2.1 time: 0.120477 Aug 31 05:23:16.324698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 313/626] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:16 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1245 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:16.330215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:16.331030 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:16.338256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:16.338948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:16.339369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:16.340352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:16.340796 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:16.341201 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:16.366905 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:16.390305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:16.392951 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:16.395130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c624026d-283f-4e4f-9e8c-3907c2891c0e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.361278 Aug 31 05:23:16.396392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 314/627] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:16 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:23:16.572948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:16.582722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6639110d-4446-4516-8f63-f7f3ea8d778a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1722 microversion: 2.1 time: 0.256624 Aug 31 05:23:16.592181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 314/628] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:16 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:17.332018 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:17.332609 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:17.339593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.340263 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.340688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:17.341362 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.341799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.342232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:17.421883 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:17.422761 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:17.425895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:17.428831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:23:17.432499 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Wed Aug 31 05:23:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 (ip 10.222.0.36) !!! Aug 31 05:23:17.436924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-22f41898-159a-4876-ac31-3e9d0344821e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1297 microversion: 2.1 time: 0.108887 Aug 31 05:23:17.438078 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 315/629] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:17 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1297 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:17.453654 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.454171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.454636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:17.457361 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.457854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.459034 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:17.607476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:17.609003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:17.619748 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.620570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.621052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:17.621799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.622414 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.623155 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:17.631627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:17.640215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:17.643252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:17.645191 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4a37c656-8624-4bef-87d7-22b2ef79480e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.230666 Aug 31 05:23:17.645744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 315/630] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:17 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:23:17.781006 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:17.784626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:17.790074 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cbe141f0-a7a6-4bae-9b43-c6db65641445 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1699 microversion: 2.1 time: 0.188241 Aug 31 05:23:17.791067 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 316/631] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:17 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1699 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:23:17.811147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-38050a4c-1d8b-4bef-b592-c43a76ed93f0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:17.817344 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-38050a4c-1d8b-4bef-b592-c43a76ed93f0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.817755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-38050a4c-1d8b-4bef-b592-c43a76ed93f0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.818230 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-38050a4c-1d8b-4bef-b592-c43a76ed93f0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:17.840146 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-38050a4c-1d8b-4bef-b592-c43a76ed93f0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Going to try to start instance {{(pid=120608) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 05:23:17.889731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-38050a4c-1d8b-4bef-b592-c43a76ed93f0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/action" status: 202 len: 0 microversion: 2.1 time: 0.082238 Aug 31 05:23:17.890980 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 316/632] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:23:17 2022] POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:23:17.902376 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:17.902982 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:17.927055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.927674 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.928255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:17.928962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:17.929420 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:17.929837 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:18.233790 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:18.242531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2964af70-d93d-4ebf-843e-bbce4cfebafa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1708 microversion: 2.1 time: 0.343573 Aug 31 05:23:18.243428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 317/633] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:17 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1708 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:18.462368 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:18.468227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:18.476273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:18.477177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:18.477773 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:18.479319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:18.480361 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:18.480955 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:18.623611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:18.631265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fa4e1599-0275-4cc4-9071-acbf8d846ecd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1303 microversion: 2.1 time: 0.173961 Aug 31 05:23:18.645268 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 317/634] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:18 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1303 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:18.669072 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:18.669682 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:18.676628 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:18.677467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:18.678093 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:18.679047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:18.683635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:18.684362 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:19.002453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:19.012016 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:19.013781 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:19.015741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d8392cbe-bae4-4fa0-bf9b-1a23ce806408 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.350186 Aug 31 05:23:19.016406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 318/635] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:18 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:19.264668 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:19.266178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:19.275850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:19.278161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:19.278693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:19.280113 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:19.281039 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:19.281465 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:19.479076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:19.490900 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5b6173d1-7605-4325-b036-9104160fe0e0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1708 microversion: 2.1 time: 0.231037 Aug 31 05:23:19.506924 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 318/636] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:19 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1708 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:19.652443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:19.653047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:19.661222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:19.661700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:19.662159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:19.663109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:19.663751 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:19.664163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:19.910858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:19.920525 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-55aa39f7-7f1b-45d7-865a-e710d6f2a34b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.271857 Aug 31 05:23:19.921233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 319/637] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:19 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:20.041221 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:20.041779 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:20.059260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:20.059751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:20.060183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:20.060915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:20.062373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:20.064202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:20.426221 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:20.434948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:20.436443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:20.437650 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ea43786d-1136-479b-804f-ee9322b5e5fc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.400572 Aug 31 05:23:20.438929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 319/638] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:20 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:20.515802 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:20.517192 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:20.540557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:20.541044 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:20.544232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:20.544945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:20.546347 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:20.546662 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:20.776887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:20.792480 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bd58daf5-6937-4ef5-8dfb-08016219cc78 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1708 microversion: 2.1 time: 0.282393 Aug 31 05:23:20.793100 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 320/639] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:20 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1708 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:20.925790 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-e7c76d52-a1d3-450a-9997-9c90753b3893 req-a17d1b3a-7d76-4680-9ee7-15c59c631f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a5a34a1-208a-4c29-b73f-70cfdb2e7979", "tag": "4d1c2526-a4f2-4a86-a757-af684a073abd"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:20.948079 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-e7c76d52-a1d3-450a-9997-9c90753b3893 req-a17d1b3a-7d76-4680-9ee7-15c59c631f87 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:20.948625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-e7c76d52-a1d3-450a-9997-9c90753b3893 req-a17d1b3a-7d76-4680-9ee7-15c59c631f87 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:20.949115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-e7c76d52-a1d3-450a-9997-9c90753b3893 req-a17d1b3a-7d76-4680-9ee7-15c59c631f87 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:20.951898 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:20.952609 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:20.959728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:20.963614 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:20.964803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-e7c76d52-a1d3-450a-9997-9c90753b3893 req-a17d1b3a-7d76-4680-9ee7-15c59c631f87 service nova] Creating event network-changed:4d1c2526-a4f2-4a86-a757-af684a073abd for instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 on hv-cinder-85220 Aug 31 05:23:20.967378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:20.970652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-e7c76d52-a1d3-450a-9997-9c90753b3893 req-a17d1b3a-7d76-4680-9ee7-15c59c631f87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049671 Aug 31 05:23:20.971976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 320/640] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:23:20.977429 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:20.978269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:20.979505 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:21.224473 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:21.233156 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-685df51e-0508-4f7a-add1-a63c03d850ca tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.287042 Aug 31 05:23:21.233818 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 321/641] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:20 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:23:21.461672 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:21.463891 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:21.470521 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:21.471304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:21.472040 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:21.473378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:21.474063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:21.474787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:21.633335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:21.643215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:21.645855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:21.647051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f38629f1-472d-483b-8f63-ce0c8904a53e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.189938 Aug 31 05:23:21.648015 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 321/642] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:21 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:21.816286 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:21.816997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:21.824322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:21.825004 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:21.825422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:21.826294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:21.826917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:21.827504 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:21.961146 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:21.970206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5b088f27-3868-465b-97e6-b2bd5c45913c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1712 microversion: 2.1 time: 0.157989 Aug 31 05:23:21.970778 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 322/643] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:21 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:22.254653 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:22.255344 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:22.257656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:22.265163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:22.266279 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:22.266936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:22.267635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:22.268086 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:22.268570 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:22.418275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:22.428357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ba8fd618-7919-4c2e-8e89-a71725d5e8d8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.179079 Aug 31 05:23:22.428939 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 322/644] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:22 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:22.671522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:22.672871 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:22.679840 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:22.680294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:22.681057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:22.682186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:22.683503 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:22.684048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:22.825645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:22.839238 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:22.841000 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:22.842277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c9d4600d-b9ed-4d84-be9f-577b1df0d349 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.175341 Aug 31 05:23:22.843062 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 323/645] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:22 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:23.449543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:23.451059 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:23.459442 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:23.459926 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:23.460351 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:23.461055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:23.461492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:23.461985 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:23.612380 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:23.638852 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-69f64dbc-4d51-4e1d-9d9a-965852dfdd86 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.193924 Aug 31 05:23:23.639774 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 323/646] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:23 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:23.867089 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:23.868473 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:23.874890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:23.875552 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:23.876129 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:23.876958 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:23.877611 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:23.878497 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:23.917715 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=4 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:24.022863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:24.031458 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:24.033119 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:24.034426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e04f9449-d94c-442f-b4c3-c43dce4066d8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.171174 Aug 31 05:23:24.035159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 324/647] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:23 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:24.672954 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:24.673557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:24.679858 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:24.680368 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:24.680786 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:24.681459 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:24.681897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:24.682329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:24.880950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:24.888998 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-34c7f204-881d-4f22-8069-82653cbd37a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.219963 Aug 31 05:23:24.889560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 324/648] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:24 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:25.061801 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:25.062811 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:25.071635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:25.072110 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:25.072534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:25.073205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:25.073643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:25.074049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:25.204947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:25.213515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:25.215043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:25.216182 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-df6d4bb6-d21c-4241-b8da-430a29211b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1738 microversion: 2.20 time: 0.161081 Aug 31 05:23:25.216740 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 325/649] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:25 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:25.908793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:25.909508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:25.915936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:25.916450 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:25.916904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:25.917581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:25.918034 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:25.918565 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:26.075229 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:26.095478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:26.103301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f1498c17-f4f1-4ada-a7c9-cb566d92f8ad tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.198343 Aug 31 05:23:26.103867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 325/650] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:25 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:26.239314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:26.239923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:26.242295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:26.247510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:26.247979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:26.248398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:26.249101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:26.249520 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:26.249927 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:26.383886 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:26.392574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:26.394037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:26.395241 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c95b0348-a8da-4903-a2cc-fa4ae48b1604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1720 microversion: 2.20 time: 0.160067 Aug 31 05:23:26.395807 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 326/651] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:26 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:27.127446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:27.128306 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:27.130205 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=8 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:27.135729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:27.136201 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:27.136625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:27.137297 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:27.137740 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:27.138197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:27.269475 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:27.277418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d7afac6c-9fb7-4513-a126-57b5a1946670 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.156321 Aug 31 05:23:27.277991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 326/652] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:27 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:27.421212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:27.421987 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:27.429815 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:27.430320 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:27.430746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:27.431415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:27.431853 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:27.432263 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:27.563961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:27.576283 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:27.578382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:27.580045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a3c28c3f-6853-4438-aaa4-bfd201df66ad tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1720 microversion: 2.20 time: 0.164996 Aug 31 05:23:27.580725 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 327/653] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:27 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:28.298811 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:28.299444 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:28.306286 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:28.306767 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:28.307191 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:28.307878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:28.308325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:28.308741 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:28.312838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:28.443322 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:28.451421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c8ecda4d-a6f0-40ae-87eb-0171a7fc792d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.157272 Aug 31 05:23:28.452198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 327/654] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:28 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:28.578038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-480f8ffd-88db-4b6d-b09c-dc1dc6401f35 req-34850242-59e5-458c-91ec-657ecb75739d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5a34a1-208a-4c29-b73f-70cfdb2e7979", "name": "network-vif-plugged", "status": "completed", "tag": "4d1c2526-a4f2-4a86-a757-af684a073abd"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:28.589164 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-480f8ffd-88db-4b6d-b09c-dc1dc6401f35 req-34850242-59e5-458c-91ec-657ecb75739d service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:28.589630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-480f8ffd-88db-4b6d-b09c-dc1dc6401f35 req-34850242-59e5-458c-91ec-657ecb75739d service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:28.590077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-480f8ffd-88db-4b6d-b09c-dc1dc6401f35 req-34850242-59e5-458c-91ec-657ecb75739d service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:28.601055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-480f8ffd-88db-4b6d-b09c-dc1dc6401f35 req-34850242-59e5-458c-91ec-657ecb75739d service nova] Creating event network-vif-plugged:4d1c2526-a4f2-4a86-a757-af684a073abd for instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 on hv-cinder-85220 Aug 31 05:23:28.603019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:28.603615 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:28.606997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-480f8ffd-88db-4b6d-b09c-dc1dc6401f35 req-34850242-59e5-458c-91ec-657ecb75739d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Aug 31 05:23:28.608378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 328/655] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:23:28.610320 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:28.610794 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:28.611218 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:28.611900 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:28.612310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:28.612721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:28.750625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:28.759489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:28.761751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:28.763711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8c4221d9-cb7b-4209-9bf5-14a1407aacba tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1723 microversion: 2.20 time: 0.164600 Aug 31 05:23:28.764301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 328/656] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:28 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:28.786663 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dd087a4-b9f4-4c87-90a3-05d3b77ed5e5"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:28.791481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:28.798440 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:28.798965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:28.799390 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:28.800088 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:28.800533 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:28.800948 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:29.112383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-53d98092-5407-4d73-8fba-f7030bffb292 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330063 Aug 31 05:23:29.113173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 329/657] 10.222.0.36 () {62 vars in 1364 bytes} [Wed Aug 31 05:23:28 2022] POST /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:23:29.237830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:29.238514 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:29.244963 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:29.245434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:29.245854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:29.246566 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:29.247003 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:29.247410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:29.290587 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120608) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 05:23:29.380468 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3663dab6-a95b-48ee-92b1-4d3f922f8d22 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/action" status: 202 len: 0 microversion: 2.20 time: 0.146577 Aug 31 05:23:29.381760 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 329/658] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Aug 31 05:23:29 2022] POST /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:23:29.389298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:29.389895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:29.395989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:29.396454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:29.396888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:29.397559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:29.398053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:29.398464 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:29.473318 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:29.474318 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:29.481018 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:29.481498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:29.481914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:29.482795 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:29.483231 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:29.483633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:29.568647 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:29.577424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:29.578873 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:29.580020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4dbe65f5-aa97-4585-a2e5-84531b5bcc61 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1749 microversion: 2.20 time: 0.194679 Aug 31 05:23:29.580598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 330/659] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:29 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1749 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:29.630785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:29.638548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cb95e67d-ce0b-4f49-9a1c-d8582b7ac029 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.170363 Aug 31 05:23:29.639122 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 330/660] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:29 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:30.606557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:30.607612 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:30.616924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:30.617460 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:30.618084 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:30.618844 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:30.619289 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:30.619703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:30.636226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-4ba81ab0-c345-4edc-947e-fe70d6b76f22 req-81420ab4-85ed-416b-a8db-188be27cb98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b209be4-6027-4328-a956-5deea7de1a64", "name": "network-vif-unplugged", "status": "completed", "tag": "918fbec4-f9a6-4f49-98c8-ddb91a52e37a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:30.639176 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:30.652189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-4ba81ab0-c345-4edc-947e-fe70d6b76f22 req-81420ab4-85ed-416b-a8db-188be27cb98c service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:30.652669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-4ba81ab0-c345-4edc-947e-fe70d6b76f22 req-81420ab4-85ed-416b-a8db-188be27cb98c service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:30.653088 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-4ba81ab0-c345-4edc-947e-fe70d6b76f22 req-81420ab4-85ed-416b-a8db-188be27cb98c service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:30.668968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.compute.server_external_events [req-4ba81ab0-c345-4edc-947e-fe70d6b76f22 req-81420ab4-85ed-416b-a8db-188be27cb98c service nova] Unable to find a host for instance 5b209be4-6027-4328-a956-5deea7de1a64. Dropping event network-vif-unplugged {{(pid=120608) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 05:23:30.668968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-4ba81ab0-c345-4edc-947e-fe70d6b76f22 req-81420ab4-85ed-416b-a8db-188be27cb98c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035844 Aug 31 05:23:30.668968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 331/661] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 05:23:30.673240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:30.673831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:30.679994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:30.680470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:30.680890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:30.681561 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:30.682026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:30.682427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:30.806599 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:30.815577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:30.816982 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:30.818169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-96dd9925-736d-4d6f-ace8-68a390746037 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1751 microversion: 2.20 time: 0.218132 Aug 31 05:23:30.818738 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 331/662] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:30 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:30.845715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:30.853771 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-414917dd-68bc-459b-b221-70f819a6460e tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1370 microversion: 2.1 time: 0.183998 Aug 31 05:23:30.854384 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 332/663] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:30 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:31.845307 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:31.846410 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:31.855444 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:31.856235 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:31.856915 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:31.857676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:31.858465 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:31.859112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:31.878103 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:31.878688 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:31.884985 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:31.885403 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:31.885826 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:31.886535 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:31.886979 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:31.887394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:32.062906 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:32.070791 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:32.072851 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:32.074397 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:32.075645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c2397541-ebda-4f0d-801f-214ea9d4a911 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1751 microversion: 2.20 time: 0.236993 Aug 31 05:23:32.076204 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 332/664] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:31 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1751 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:32.079094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8872997c-0238-43c6-888a-39a6e97854e2 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1563 microversion: 2.1 time: 0.207144 Aug 31 05:23:32.079663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 333/665] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:23:31 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:23:32.098623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:32.099094 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:32.105309 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:32.105771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:32.106226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:32.106884 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:32.107314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:32.107716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:32.192634 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6e0bcd8b-e19b-45bf-a85e-2dfb1ee8f8a3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097621 Aug 31 05:23:32.193265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 333/666] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 05:23:32 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:23:33.098375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:33.099141 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:33.105738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:33.106257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:33.106683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:33.107368 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:33.107817 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:33.108226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:33.373621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:33.382693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:33.384158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:33.385318 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-668c9035-c85d-4e5c-bc16-b75ce800422b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.291058 Aug 31 05:23:33.385888 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 334/667] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:33 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:33.594974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-c0def51a-4f40-410f-88a0-dc0885fa9b53 req-f67551ff-8317-4a9e-b01f-c814672d9acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a5a34a1-208a-4c29-b73f-70cfdb2e7979", "tag": "4d1c2526-a4f2-4a86-a757-af684a073abd"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:23:33.605656 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c0def51a-4f40-410f-88a0-dc0885fa9b53 req-f67551ff-8317-4a9e-b01f-c814672d9acd service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:33.606463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c0def51a-4f40-410f-88a0-dc0885fa9b53 req-f67551ff-8317-4a9e-b01f-c814672d9acd service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:33.607093 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c0def51a-4f40-410f-88a0-dc0885fa9b53 req-f67551ff-8317-4a9e-b01f-c814672d9acd service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:33.619042 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-c0def51a-4f40-410f-88a0-dc0885fa9b53 req-f67551ff-8317-4a9e-b01f-c814672d9acd service nova] Creating event network-changed:4d1c2526-a4f2-4a86-a757-af684a073abd for instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 on hv-cinder-85220 Aug 31 05:23:33.624685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-c0def51a-4f40-410f-88a0-dc0885fa9b53 req-f67551ff-8317-4a9e-b01f-c814672d9acd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Aug 31 05:23:33.625512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 334/668] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:23:34.408881 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:34.409491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:34.423846 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:34.424458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:34.424883 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:34.425581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:34.426042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:34.426463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:34.574405 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:34.583586 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:34.585421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:34.586961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f625f405-4074-481a-ad10-201fbd8f566f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.182615 Aug 31 05:23:34.588219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 335/669] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:34 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:35.611830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:35.612716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:35.620274 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:35.620751 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:35.621171 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:35.621860 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:35.622333 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:35.622729 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:35.811579 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:35.820029 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:35.821422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:35.822589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e41792d5-af20-4e25-a32f-67177965af23 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.215663 Aug 31 05:23:35.823150 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 335/670] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:35 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:36.845245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:36.845838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:36.852402 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:36.852882 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:36.853300 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:36.853969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:36.854782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:36.855210 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:37.045570 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:37.057698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:37.059163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:37.060331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-39304c7e-a83f-4c10-a3b8-ddfecb3fa64f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.219252 Aug 31 05:23:37.060868 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 336/671] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:36 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:38.085575 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:38.086281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:38.093056 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:38.093559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:38.094031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:38.094742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:38.095190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:38.095598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:38.237615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:38.246540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:38.248073 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:38.249227 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-decc9a37-7b93-4550-bc7f-ce7140344e20 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.168131 Aug 31 05:23:38.249826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 336/672] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:38 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:39.272211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:39.272999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:39.279380 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:39.279855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:39.280274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:39.280985 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:39.281385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:39.281791 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:39.419232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:39.428526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:39.429940 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:39.431118 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a5a01a12-b599-4fb0-abe8-07e584a8219b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.162910 Aug 31 05:23:39.431870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 337/673] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:39 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:40.453999 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:40.454643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:40.462471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:40.462981 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:40.463403 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:40.464087 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:40.464508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:40.464907 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:40.605344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:40.614547 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:40.615934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:40.617121 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c2f987d6-0fd5-4465-8486-fcde5d1c1f12 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.167143 Aug 31 05:23:40.617652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 337/674] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:40 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:41.644578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:41.646172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:41.654743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:41.655588 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:41.658988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:41.659958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:41.660489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:41.660979 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:41.804652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:41.814516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:41.815996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:41.817227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-93e2f77b-17b9-423e-96b9-f101964ac38c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.179294 Aug 31 05:23:41.817813 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 338/675] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:41 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:42.840705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:42.841385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:42.848409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:42.848877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:42.849300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:42.849972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:42.850442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:42.850850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:42.982504 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:42.992779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:42.994264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:42.995421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-85b3fb22-596b-43fd-96ac-c0fbaa44b8f4 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.159036 Aug 31 05:23:42.996161 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 338/676] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:42 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:44.018429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:44.019089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:44.025639 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:44.026152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:44.026576 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:44.028143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:44.028143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:44.028143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:44.166734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:44.175826 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:44.177224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:44.178435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f04445f5-c5c9-4c49-bdb2-9752579a689d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.164040 Aug 31 05:23:44.179319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 339/677] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:44 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:45.201870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:45.202623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:45.209397 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:45.209870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:45.210325 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:45.211024 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:45.211460 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:45.211873 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:45.352134 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:45.361517 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:45.362983 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:45.364221 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c4e2111e-380d-4b6a-923c-500d83fbed55 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.166415 Aug 31 05:23:45.364982 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 339/678] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:45 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:46.387239 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:46.388865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:46.397094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:46.398208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:46.398858 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:46.399728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:46.400224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:46.400733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:46.545768 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:46.554767 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:46.556177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:46.557333 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0483b3bb-6aa6-4b74-9883-cd664543250a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.174129 Aug 31 05:23:46.558159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 340/679] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:46 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:47.580680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:47.581296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:47.588336 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:47.588822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:47.589229 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:47.590153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:47.590598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:47.591029 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:47.727021 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:47.736302 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:47.737706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:47.738933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b5dc8362-1a07-4c15-85ef-86680082fcb9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.162249 Aug 31 05:23:47.739494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 340/680] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:47 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:48.761374 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:48.761973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:48.768370 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:48.768848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:48.769327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:48.769916 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:48.770463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:48.770878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:48.996416 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:49.005042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:49.006488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:49.007637 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-609d3fab-40de-4649-bf06-d83ed99128ef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.250210 Aug 31 05:23:49.008199 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 341/681] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:48 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:50.034614 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:50.035726 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:50.046644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:50.047437 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:50.048143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:50.049247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:50.049984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:50.050679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:50.194314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:50.207292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:50.209388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:50.210866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5b6cda73-913f-4302-b908-4b01016f4057 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.182642 Aug 31 05:23:50.211524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 341/682] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:50 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:51.244770 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:51.245729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:51.255303 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:51.255782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:51.256204 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:51.256873 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:51.257321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:51.257731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:51.391530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:51.400249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:51.401661 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:51.402805 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b6697a71-d6d3-4e1a-9add-9b27585a3b4f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.164574 Aug 31 05:23:51.403405 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 342/683] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:51 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:52.429706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:52.430680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:52.441509 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:52.442160 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:52.442624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:52.443309 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:52.443762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:52.444176 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:52.584577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:52.597377 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:52.599251 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:52.600384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cc491190-2270-4ddb-aaaf-47b7adef8952 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.177323 Aug 31 05:23:52.600947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 342/684] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:52 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:53.624126 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:53.624744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:53.627256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:53.634205 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:53.634880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:53.635477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:53.636453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:53.636929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:53.644281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:53.664737 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:53.842984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:53.851959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:53.853378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:53.854865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5270e1d0-02b5-4b55-8e87-4615fb913d3f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.235334 Aug 31 05:23:53.855430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 343/685] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:53 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:54.882254 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:54.883101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:54.894689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:54.895463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:54.896158 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:54.897256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:54.897982 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:54.898720 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:55.042360 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:55.051005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:55.052408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:55.053551 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d22a690b-4f98-4fc2-9308-49727f01af10 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.178502 Aug 31 05:23:55.054135 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 343/686] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:54 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:56.080288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:56.081229 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:56.088066 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:56.088543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:56.088962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:56.089634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:56.090106 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:56.090512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:56.222755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:56.232161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:56.233583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:56.234854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-58fcaf21-0cd1-48d5-bb6c-94c0b72131df tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.160999 Aug 31 05:23:56.235446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 344/687] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:56 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:57.261594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:57.262661 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:57.267184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:23:57.267450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Wed Aug 31 05:23:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 (ip 10.222.0.36) !!! Aug 31 05:23:57.269965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=36 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:57.277842 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:57.278422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:57.278846 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:57.279527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:57.279968 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:57.280378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:57.413752 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:57.427291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:57.428908 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:57.430077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9bd00c13-f6a0-44b2-91f4-e25a70b78748 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.175208 Aug 31 05:23:57.430695 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 344/688] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:57 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:58.457410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:58.458316 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:58.468427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:58.469214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:58.469913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:58.471074 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:58.471798 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:58.472473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:58.602323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:58.611778 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:58.613190 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:58.614388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-db6fe0ce-9c3a-475b-8c5a-da546d7a013b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.163640 Aug 31 05:23:58.614924 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 345/689] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:58 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:23:59.641356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:23:59.642314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:23:59.650816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:59.651311 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:59.651735 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:59.652441 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:23:59.652867 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:23:59.653270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:23:59.784993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:59.798259 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:59.800432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:23:59.802171 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a3bb4f97-9f48-4cfa-afe9-a43c54e4d711 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.167039 Aug 31 05:23:59.802789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 345/690] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:23:59 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:00.829384 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:00.830384 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:00.840637 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:00.841469 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:00.842211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:00.843329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:00.844050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:00.844738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:00.981539 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:00.994849 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:00.997054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:00.998787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a9033eed-508b-4340-858a-281901105172 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.176040 Aug 31 05:24:00.999632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 346/691] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:24:00 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:02.024777 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:02.025359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:02.032389 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:02.032869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:02.033288 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:02.033970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:02.034434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:02.034843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:02.037486 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=81 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:02.167600 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:02.176198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:02.177625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:02.178810 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0c37f576-2e67-4a19-bb58-ff04300f948c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.158693 Aug 31 05:24:02.179404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 346/692] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:24:02 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:03.203101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:03.203670 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:03.210659 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:03.211169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:03.211631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:03.212342 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:03.212876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:03.213325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:03.349710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:03.358741 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:03.360141 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:03.361326 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-838e0635-d1b9-465e-b9cd-a08623432348 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.162371 Aug 31 05:24:03.361912 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 347/693] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:24:03 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:04.386962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:04.387691 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:04.396001 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:04.396562 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:04.397090 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:04.397922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:04.398508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:04.399025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:04.529323 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:04.538427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:04.539823 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:04.540978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-73a61124-73f1-4e76-9198-23725174551d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.159136 Aug 31 05:24:04.541542 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 347/694] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:24:04 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:04.732971 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-d94e3990-9686-41bb-9dc1-2e814e704f55 req-8b4f8238-90dc-4eb9-beda-4d80e27e6487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b209be4-6027-4328-a956-5deea7de1a64", "name": "network-vif-plugged", "status": "completed", "tag": "918fbec4-f9a6-4f49-98c8-ddb91a52e37a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:24:04.743192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d94e3990-9686-41bb-9dc1-2e814e704f55 req-8b4f8238-90dc-4eb9-beda-4d80e27e6487 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:04.743774 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d94e3990-9686-41bb-9dc1-2e814e704f55 req-8b4f8238-90dc-4eb9-beda-4d80e27e6487 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:04.744190 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d94e3990-9686-41bb-9dc1-2e814e704f55 req-8b4f8238-90dc-4eb9-beda-4d80e27e6487 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:04.756051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-d94e3990-9686-41bb-9dc1-2e814e704f55 req-8b4f8238-90dc-4eb9-beda-4d80e27e6487 service nova] Creating event network-vif-plugged:918fbec4-f9a6-4f49-98c8-ddb91a52e37a for instance 5b209be4-6027-4328-a956-5deea7de1a64 on hv-cinder-85220 Aug 31 05:24:04.761125 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-d94e3990-9686-41bb-9dc1-2e814e704f55 req-8b4f8238-90dc-4eb9-beda-4d80e27e6487 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032157 Aug 31 05:24:04.761719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 348/695] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:24:05.564494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:05.565057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:05.572059 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:05.572541 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:05.572995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:05.573669 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:05.574142 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:05.574552 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:05.722435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:05.731714 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:05.733233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:05.734446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-059ed54a-00d2-41d9-ab47-583fe9cc5b37 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.174472 Aug 31 05:24:05.735026 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 348/696] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:24:05 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:06.762313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:06.763645 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:06.773692 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:06.774200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:06.774625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:06.775365 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:06.775810 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:06.776220 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:06.921580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:06.930449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:06.931905 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:06.933088 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-14d26e79-f8da-4cba-8fef-f54613e052e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.177923 Aug 31 05:24:06.933651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 349/697] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:24:06 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:07.956175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:07.956835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:07.964212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:07.965217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:07.965636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:07.966357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:07.966798 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:07.967204 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:08.128694 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:08.142170 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:08.144383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:08.146072 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c0a78803-541c-4772-bc3c-b2f8ca0e9e24 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1807 microversion: 2.20 time: 0.193624 Aug 31 05:24:08.146899 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 349/698] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:24:07 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:09.173081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:09.173992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:09.182289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:09.182765 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:09.183191 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:09.183869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:09.184311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:09.184726 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:09.335955 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:09.350260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:09.351836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:09.353003 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cab0f7cc-4712-4447-8a3a-80450860058a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1794 microversion: 2.20 time: 0.186623 Aug 31 05:24:09.353856 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 350/699] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:24:09 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1794 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:24:35.678223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:24:35.680456 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:35.683027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=11 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:35.683692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=23 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:35.690759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:35.691534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:35.691973 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:35.692673 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:35.693329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:35.694015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:35.775606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-68ee65e7-de55-4549-84fe-5ae31138dd8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "POST /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/action" status: 202 len: 0 microversion: 2.1 time: 0.101306 Aug 31 05:24:35.776241 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 350/700] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:24:35 2022] POST /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:24:35.786240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:35.786625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:35.788836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=15 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:35.789510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=40 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:35.795386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:35.796008 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:35.796554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:35.797265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:35.797708 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:35.799011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:36.021777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:36.032965 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-42902d21-4a0d-40a4-a0cd-c1bc7207b782 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1749 microversion: 2.1 time: 0.251483 Aug 31 05:24:36.033534 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 351/701] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:35 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:37.060724 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:37.061848 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:37.072284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:37.073065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:37.073718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:37.074753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:37.075185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:37.075661 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:37.228696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:37.237341 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a76f51c9-1b90-4c22-9b57-c1f49e540263 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.184462 Aug 31 05:24:37.237881 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 351/702] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:37 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:38.262896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:38.263911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:38.274476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:38.275318 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:38.276019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:38.277182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:38.277692 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:38.278130 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:38.420906 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:38.431553 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-98a14a5a-31d1-4ab5-a581-67ea5522c076 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.174981 Aug 31 05:24:38.432488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 352/703] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:38 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:39.460700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:39.462069 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:39.470018 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:39.470654 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:39.471080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:39.471755 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:39.472194 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:39.472604 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:39.628262 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:39.637200 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0eab1506-481f-430f-9281-d26bd21482f2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.185767 Aug 31 05:24:39.643879 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 352/704] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:39 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:40.660844 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:40.661438 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:40.667874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:40.668397 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:40.668821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:40.669477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:40.669939 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:40.670388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:40.818070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:40.828969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ed9fe503-e039-42af-96ec-caaa6e556d83 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.172071 Aug 31 05:24:40.829564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 353/705] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:40 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:41.833836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:41.834582 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:41.842788 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:41.843374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:41.843806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:41.844447 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:41.844920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:41.845322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:41.857585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:41.858274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:41.864446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:41.864911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:41.865327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:41.865991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:41.866456 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:41.866864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:41.967303 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lazy-loading 'services' on Instance uuid 3104f831-5ba5-4ca1-a955-789bae89cb67 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:24:42.014070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:42.022664 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-65e786f1-c66b-4d66-88aa-26f2d50ac478 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.169788 Aug 31 05:24:42.023504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 354/706] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:41 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:42.086548 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-503b9f4e-4aeb-4b01-a61b-1f619c85e451 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/os-volume_attachments/dd42074e-5d05-4a5f-9963-07f0de637d10" status: 202 len: 0 microversion: 2.1 time: 0.369296 Aug 31 05:24:42.087151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 353/707] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:24:41 2022] DELETE /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/os-volume_attachments/dd42074e-5d05-4a5f-9963-07f0de637d10 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:24:43.048975 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:43.050134 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:43.060299 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:43.061091 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:43.061797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:43.062974 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:43.063708 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:43.064396 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:43.223588 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:43.232549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-26366566-2cbe-444e-b5e4-5d316f77e736 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.190118 Aug 31 05:24:43.233111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 355/708] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:43 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:44.254371 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:44.255075 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:44.262264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:44.262742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:44.263274 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:44.263806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:44.264246 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:44.264657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:44.281810 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-895cfd1e-e58f-4e52-badd-d1b7b7567996 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:24:44.287765 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-895cfd1e-e58f-4e52-badd-d1b7b7567996 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:44.288232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-895cfd1e-e58f-4e52-badd-d1b7b7567996 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:44.288667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-895cfd1e-e58f-4e52-badd-d1b7b7567996 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:44.312502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-895cfd1e-e58f-4e52-badd-d1b7b7567996 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Going to try to stop instance {{(pid=120608) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 05:24:44.363810 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-895cfd1e-e58f-4e52-badd-d1b7b7567996 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/action" status: 202 len: 0 microversion: 2.1 time: 0.085725 Aug 31 05:24:44.364419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 356/709] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:24:44 2022] POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:24:44.372830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:44.373511 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:44.379621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:44.380089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:44.380540 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:44.381215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:44.381664 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:44.382102 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:44.416383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:44.424855 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d743edac-707d-41a1-8fb1-a0cb9537d368 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.174827 Aug 31 05:24:44.425433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 354/710] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:44 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:44.512533 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:44.520465 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d4dc25ab-3e48-48bf-83f2-fec4bd946ef0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.151684 Aug 31 05:24:44.521057 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 357/711] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:44 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:24:45.449277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:45.450228 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:45.458421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:45.459006 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:45.459529 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:45.460359 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:45.460902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:45.461408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:45.542048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:45.542686 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:45.549167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:45.549643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:45.550093 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:45.550803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:45.551241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:45.551651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:45.643161 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:45.652214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-dfdc5f24-1ff4-422f-a2eb-812fc042bbd1 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.209405 Aug 31 05:24:45.653094 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 355/712] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:45 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:45.706915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:45.714730 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e2d28421-549d-4e63-b924-857aad3f3e7e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.176621 Aug 31 05:24:45.715330 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 358/713] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:45 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:24:46.673829 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:46.674628 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:46.681215 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:46.681676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:46.682117 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:46.682776 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:46.683197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:46.683597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:46.736775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:46.737419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:46.743680 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:46.744145 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:46.744563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:46.745235 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:46.745669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:46.746108 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:46.874417 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:46.883224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6d4987a6-5d73-420c-b301-9833048f58af tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.213309 Aug 31 05:24:46.883833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 356/714] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:46 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:46.908727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:46.917081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-719aff4c-9f08-4166-b789-ffbd45773daa tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.184137 Aug 31 05:24:46.917662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 359/715] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:46 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:24:47.905372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:47.905965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:47.913106 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:47.913587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:47.914020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:47.914695 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:47.915152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:47.915557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:47.938654 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:47.939254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:47.945647 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:47.946172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:47.946593 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:47.947263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:47.947699 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:47.948111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:48.115057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:48.123929 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-77ce3707-edea-4977-8f7e-6a6f4476f66c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1754 microversion: 2.1 time: 0.222854 Aug 31 05:24:48.124722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 357/716] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:47 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:48.139842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:48.147717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1ea641d5-049a-420e-a4d6-5299a51c8527 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.212913 Aug 31 05:24:48.148266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 360/717] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:47 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:49.150207 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:49.151250 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:49.162113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:49.162960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:49.163674 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:49.164978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:49.165728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:49.166466 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:49.171313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:49.171915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:49.178258 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:49.178746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:49.179169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:49.179853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:49.180298 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:49.180711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:49.366506 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:49.374899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1e074663-6e27-48f9-bcd5-04a4f96f24f1 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.208685 Aug 31 05:24:49.375547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 361/718] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:49 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:49.381123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:49.389851 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e00932eb-1ef9-495e-b7f0-f05224d16ba2 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1757 microversion: 2.1 time: 0.246320 Aug 31 05:24:49.390433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 358/719] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:49 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1757 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:50.400538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:50.401539 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:50.411653 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:50.412439 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:50.413142 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:50.414313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:50.415055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:50.415744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:50.557139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:50.566219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8152cbad-5d5a-40d3-a2ae-eba6b0fe8b07 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.172244 Aug 31 05:24:50.566840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 362/720] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:50 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:51.591999 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:51.592621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:51.599544 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:51.600026 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:51.600455 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:51.601138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:51.601586 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:51.602038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:51.743704 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:51.752272 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d8c215fb-d4ad-4203-902a-3f252bf2a1a6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.165859 Aug 31 05:24:51.752856 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 359/721] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:51 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:52.773971 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:52.774580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:52.780631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:52.781374 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:52.781481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:52.782367 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:52.782966 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:52.783547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:52.964365 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:52.972466 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-505fab64-316d-40aa-9efc-363fdeb0de9b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.202444 Aug 31 05:24:52.973046 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 363/722] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:52 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:53.997610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:53.998219 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:54.006345 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:54.006826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:54.007247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:54.007925 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:54.008369 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:54.008831 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:54.146561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:54.158762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0d5cc256-6027-44b4-b11e-cf005bb46179 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1676 microversion: 2.1 time: 0.165963 Aug 31 05:24:54.159647 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 360/723] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:53 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:55.186267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:55.186874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:55.193278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:55.193821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:55.194302 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:55.195293 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:55.195724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:55.196144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:55.331771 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:55.339816 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-19d7d877-6d98-4bb2-801e-b96867e782c0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1653 microversion: 2.1 time: 0.159110 Aug 31 05:24:55.340390 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 364/724] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:55 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1653 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:55.363251 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-31694141-a300-43e1-aed0-5acfa9549f6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:24:55.370185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31694141-a300-43e1-aed0-5acfa9549f6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:55.370673 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31694141-a300-43e1-aed0-5acfa9549f6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:55.371095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31694141-a300-43e1-aed0-5acfa9549f6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:55.430296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-31694141-a300-43e1-aed0-5acfa9549f6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Going to try to start instance {{(pid=120607) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 05:24:55.476242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-31694141-a300-43e1-aed0-5acfa9549f6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/action" status: 202 len: 0 microversion: 2.1 time: 0.116712 Aug 31 05:24:55.476751 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 361/725] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:24:55 2022] POST /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:24:55.485182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:55.485771 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:55.491682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:55.492237 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:55.492705 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:55.493410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:55.493887 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:55.494331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:55.628420 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:55.637921 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cfa895c3-fa0f-436a-9427-4c9bc2fadfbb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1662 microversion: 2.1 time: 0.156327 Aug 31 05:24:55.638807 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 365/726] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:55 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:56.666782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:56.667811 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:56.675028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:56.675507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:56.675920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:56.676608 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:56.677055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:56.677462 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:56.808595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:56.816939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-31ec46e1-e623-4e4b-895d-aab539d7a24c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1662 microversion: 2.1 time: 0.158002 Aug 31 05:24:56.817508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 362/727] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:56 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:24:57.840053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:24:57.840839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:24:57.849530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:57.850198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:57.850755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:57.851636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:24:57.852554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:24:57.853111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:24:57.871994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:57.988546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:24:57.996262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6384da77-366d-4b76-86e3-8435debc0d8a tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1666 microversion: 2.1 time: 0.161334 Aug 31 05:24:57.996804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 366/728] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:24:57 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:01.547135 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:01.547676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:01.553792 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:01.554290 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:01.554714 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:01.555386 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:01.555821 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:01.556226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:01.578657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lazy-loading 'flavor' on Instance uuid 84115827-b1df-419c-b693-8b9105afcbbd {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:25:01.582181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:01.657089 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6df1e667-4fe3-4c5f-a1c1-224beab7c5d1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "POST /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd/action" status: 202 len: 0 microversion: 2.1 time: 0.223751 Aug 31 05:25:01.657680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 363/729] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:25:01 2022] POST /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:25:01.666752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:01.667381 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:01.677848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:01.678363 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:01.678782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:01.679470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:01.680280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:01.680776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:01.819908 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:01.828168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-daf8df16-f76c-4e3e-95d2-386e53af774c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.165380 Aug 31 05:25:01.828744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 367/730] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:01 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:02.855426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:02.856396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:02.867446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:02.868225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:02.868920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:02.870039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:02.870773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:02.871443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:03.007493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:03.017496 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-28ec442e-8f56-4c32-a407-86d3f077b36d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.169686 Aug 31 05:25:03.018061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 364/731] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:02 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:03.401071 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9df65da-7f16-4604-9c0b-7d687511e782"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:03.404672 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:03.411290 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:03.411762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:03.412185 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:03.412851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:03.413291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:03.413701 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:03.737452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-36abea82-cf42-4481-870b-b43074edc54a tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343071 Aug 31 05:25:03.738094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 368/732] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:25:03 2022] POST /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:04.038811 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:04.039366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:04.046226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:04.046703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:04.047129 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:04.047800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:04.048248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:04.048652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:04.194911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:04.206597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-72885f2e-88db-43fb-a01a-90d257e75f47 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.171317 Aug 31 05:25:04.207419 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 365/733] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:04 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:05.234035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:05.235043 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:05.246503 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:05.247285 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:05.247976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:05.248649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:05.249092 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:05.249500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:05.385230 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:05.394331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6d0da052-63ad-450e-9a92-09601c4b609b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.168581 Aug 31 05:25:05.394896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 369/734] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:05 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:06.418722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:06.419681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:06.423513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=33 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:06.431740 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:06.432493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:06.433148 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:06.434253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:06.434950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:06.435602 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:06.567827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:06.577560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c053c179-205a-4491-83cb-644571af08c6 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.165282 Aug 31 05:25:06.578253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 366/735] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:06 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:07.607708 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:07.608512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:07.611107 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=39 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:07.617098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:07.617626 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:07.618152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:07.618875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:07.619365 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:07.619818 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:07.763400 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:07.771478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3e115275-5447-43be-9d70-335e191b0957 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.170565 Aug 31 05:25:07.772059 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 370/736] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:07 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:08.797576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:08.798554 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:08.808700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:08.809493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:08.810242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:08.811148 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:08.811584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:08.811986 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:08.950859 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:08.963357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fdf85ae1-b0a8-4521-9afb-081c34d785d5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.172106 Aug 31 05:25:08.964215 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 367/737] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:08 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:09.992695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:09.993634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:10.004529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:10.005312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:10.006064 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:10.007258 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:10.007999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:10.008682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:10.151785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:10.159910 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e699f5ef-d1e2-4d41-80f3-e70d17915861 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.176647 Aug 31 05:25:10.160516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 371/738] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:09 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:11.183774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:11.184369 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:11.192267 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:11.192733 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:11.193148 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:11.193813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:11.194282 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:11.194728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:11.320877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:11.323270 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:11.328918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:11.330042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:11.330582 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:11.331003 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:11.331689 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:11.332131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:11.332580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:11.337065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f1f1e927-4414-48db-b789-dbeb0bb99ec7 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.159583 Aug 31 05:25:11.337664 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 368/739] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:11 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:11.355860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lazy-loading 'flavor' on Instance uuid 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:25:11.479179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f5550bbf-577f-4daa-9788-48deb47934dc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/action" status: 200 len: 32 microversion: 2.1 time: 0.162349 Aug 31 05:25:11.479876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 372/740] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:25:11 2022] POST /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:25:11.490247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:11.491096 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:11.497043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:11.497512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:11.497944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:11.498645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:11.499105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:11.499501 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:11.712389 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:11.721650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4820c5a4-35a2-4b63-8edf-a35a342d22fb tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.235959 Aug 31 05:25:11.722481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 369/741] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:11 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:12.359929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:12.360729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:12.367194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:12.367666 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:12.368156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:12.368834 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:12.369276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:12.369686 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:12.649902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:12.660990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0544e371-f0e8-41ee-ba76-27020e76c1fc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.305882 Aug 31 05:25:12.661556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 373/742] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:12 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:12.744574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:12.745212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:12.752449 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:12.752956 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:12.753384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:12.754216 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:12.754656 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:12.755063 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:12.967302 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:12.979951 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7a25256b-f79d-4aa5-a254-4162628350e9 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.239629 Aug 31 05:25:12.980737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 370/743] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:12 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:13.682039 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:13.682710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:13.689591 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:13.690062 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:13.690516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:13.691211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:13.691652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:13.692114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:13.845418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:13.855059 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f506381f-2a25-4934-901a-b57c4fcdb278 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.176960 Aug 31 05:25:13.855627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 374/744] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:13 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:14.006961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:14.007875 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:14.021857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:14.022886 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:14.023588 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:14.024749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:14.025503 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:14.026226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:14.169067 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:14.178241 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f1021f89-2ab5-4376-9b3c-516f94ca5672 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.177978 Aug 31 05:25:14.178826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 371/745] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:13 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:14.886635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:14.887476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:14.897119 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:14.897617 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:14.898055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:14.898756 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:14.899202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:14.899616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:15.030973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:15.038960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ed92750f-e178-4f04-b87c-8cdf65089839 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.159085 Aug 31 05:25:15.039533 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 375/746] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:14 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:15.203444 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:15.204247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:15.215065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:15.215868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:15.216477 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:15.217602 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:15.218398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:15.219074 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:15.354208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:15.362761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ecfae468-361b-4ef6-a909-44f0a250992d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.165855 Aug 31 05:25:15.363348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 372/747] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:15 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:16.059528 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:16.060072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:16.066762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.067236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.067655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.068366 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.068831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.069215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.219775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:16.229699 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-11c1bfb5-72a9-485d-b555-b08b97dad602 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1570 microversion: 2.1 time: 0.173967 Aug 31 05:25:16.230294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 376/748] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:16 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:16.258035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:16.258643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:16.265680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.266179 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.266598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.267266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.267700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.268103 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.367845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120607) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 05:25:16.383508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:16.384734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:16.391609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.392518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.392948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.393615 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.394278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.394695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.455446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d555e945-6c28-4bb8-aec5-571e39f2eb80 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "POST /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd/action" status: 202 len: 0 microversion: 2.1 time: 0.201279 Aug 31 05:25:16.456688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 373/749] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:25:16 2022] POST /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:25:16.465394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:16.466346 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:16.473138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.473620 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.474076 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.474852 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.475312 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.476914 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.628795 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:16.637204 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e4e07ff6-caef-47e6-bb89-cdfdb1afb479 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.257467 Aug 31 05:25:16.637756 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 377/750] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:16 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:16.665208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:16.673268 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a695e620-90e9-4615-9d16-31ad4c1b4a84 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1578 microversion: 2.1 time: 0.212517 Aug 31 05:25:16.673840 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 374/751] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:16 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1578 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:25:16.678606 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:16.679301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:16.685312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.685790 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.686427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.687138 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.687550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.687959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.719562 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e67a3341-78cb-45c4-a973-a9944bb86f9c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments/0dd087a4-b9f4-4c87-90a3-05d3b77ed5e5" status: 200 len: 194 microversion: 2.20 time: 0.045140 Aug 31 05:25:16.720151 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 378/752] 10.222.0.36 () {60 vars in 1454 bytes} [Wed Aug 31 05:25:16 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments/0dd087a4-b9f4-4c87-90a3-05d3b77ed5e5 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:25:16.790028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:16.790533 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:16.796589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.797122 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.797484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.798189 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.798631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.799043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.878902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lazy-loading 'services' on Instance uuid 5b209be4-6027-4328-a956-5deea7de1a64 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:25:16.955033 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f6853611-ada1-4f92-bdfa-d0e6a43e99ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments/0dd087a4-b9f4-4c87-90a3-05d3b77ed5e5" status: 202 len: 0 microversion: 2.20 time: 0.168893 Aug 31 05:25:16.955767 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 375/753] 10.222.0.36 () {60 vars in 1457 bytes} [Wed Aug 31 05:25:16 2022] DELETE /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments/0dd087a4-b9f4-4c87-90a3-05d3b77ed5e5 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:25:16.964406 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:16.966907 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:16.973089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.973556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.973977 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:16.974825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:16.975281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:16.975678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:17.001926 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:17.007224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c9be3401-7479-4f40-9eff-c617217297b2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046933 Aug 31 05:25:17.011852 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 379/754] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Aug 31 05:25:16 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 05:25:17.659134 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:17.659806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:17.666742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:17.667212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:17.667625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:17.668290 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:17.668743 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:17.669144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:17.695152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:17.695736 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:17.703007 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:17.703478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:17.703914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:17.704677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:17.705296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:17.705735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:17.875223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:17.878822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:17.885482 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0059b53f-4e5c-4e6b-a015-f3a8df7977e1 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.230553 Aug 31 05:25:17.886095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 376/755] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:17 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:17.888126 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:17.895992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f91567c3-ff8b-4ee2-b874-4c6471d65865 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1520 microversion: 2.1 time: 0.205045 Aug 31 05:25:17.896522 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 380/756] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:17 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:18.021587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:18.023979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:18.030741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:18.031212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:18.031626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:18.032293 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:18.032724 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:18.033144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:18.065814 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b6641d9e-bc69-4f39-8447-ca6e6977f839 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049457 Aug 31 05:25:18.066385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 377/757] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Aug 31 05:25:18 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:25:18.907331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:18.907980 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:18.915182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:18.915655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:18.916076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:18.916750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:18.917133 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:18.917564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:18.917564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:18.917908 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:18.926332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:18.926788 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:18.927387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:18.928305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:18.928745 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:18.929336 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:19.141063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:19.148442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:19.151597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-45bdb033-1c63-49b7-97b8-6932aa1b7f5f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.248537 Aug 31 05:25:19.152625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 381/758] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:18 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:19.161786 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-778d4f75-711a-4f12-a902-0412a7e169a1 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1520 microversion: 2.1 time: 0.248781 Aug 31 05:25:19.163016 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:19.165767 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 378/759] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:18 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:25:19.166983 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:19.182984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:19.183737 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:19.184159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:19.184841 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:19.185351 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:19.185759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:19.237530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3493b75a-82ff-47e7-b022-a0803615723e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083781 Aug 31 05:25:19.238177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 382/760] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Aug 31 05:25:19 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:19.247186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-9d5657ad-d107-426d-9f68-d6a894752ae4 req-e1ee7498-dda6-4b11-b8ed-8f26061ca0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84115827-b1df-419c-b693-8b9105afcbbd", "name": "network-vif-unplugged", "status": "completed", "tag": "3a5ee679-8365-4a8d-a3d4-4874a75745af"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:19.257631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-9d5657ad-d107-426d-9f68-d6a894752ae4 req-e1ee7498-dda6-4b11-b8ed-8f26061ca0a2 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:19.258423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-9d5657ad-d107-426d-9f68-d6a894752ae4 req-e1ee7498-dda6-4b11-b8ed-8f26061ca0a2 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:19.258841 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-9d5657ad-d107-426d-9f68-d6a894752ae4 req-e1ee7498-dda6-4b11-b8ed-8f26061ca0a2 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:19.271028 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-9d5657ad-d107-426d-9f68-d6a894752ae4 req-e1ee7498-dda6-4b11-b8ed-8f26061ca0a2 service nova] Creating event network-vif-unplugged:3a5ee679-8365-4a8d-a3d4-4874a75745af for instance 84115827-b1df-419c-b693-8b9105afcbbd on hv-cinder-85220 Aug 31 05:25:19.276321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-9d5657ad-d107-426d-9f68-d6a894752ae4 req-e1ee7498-dda6-4b11-b8ed-8f26061ca0a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109367 Aug 31 05:25:19.277769 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 379/761] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:19.299660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:19.300140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:19.306043 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:19.306502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:19.306921 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:19.307583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:19.308046 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:19.308454 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:19.332522 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:25:19.408447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4b4dce20-1809-4721-bb02-736668ea04db tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 204 len: 0 microversion: 2.20 time: 0.112349 Aug 31 05:25:19.408951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 383/762] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Aug 31 05:25:19 2022] DELETE /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 05:25:19.417748 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:19.418586 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:19.424645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:19.425110 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:19.425521 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:19.426211 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:19.426639 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:19.427037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:19.567130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:19.576469 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:19.578045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:19.579232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3ac11b67-94e3-4c13-ba2f-8a7e28e1648d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.165720 Aug 31 05:25:19.580071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 380/763] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:19 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:20.173854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:20.174573 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:20.181665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:20.182179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:20.182605 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:20.183261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:20.183725 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:20.184139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:20.186549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:20.187175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:20.193758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:20.194265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:20.194683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:20.195355 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:20.195797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:20.196205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:20.377766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:20.381785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:20.386385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5e3294e5-8f50-42e4-a002-e5f600184a7c tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.216767 Aug 31 05:25:20.387048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 384/764] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:20 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:20.389870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-095572c1-e4cb-490f-869c-e0ca2a46e81d tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.207107 Aug 31 05:25:20.390472 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 381/765] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:20 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:20.604370 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:20.604994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:20.611322 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:20.611797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:20.612294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:20.612975 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:20.613422 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:20.613839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:20.743341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:20.751550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:20.753037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:20.754206 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cb10572a-b557-4047-bf3f-f5c7dd56b03d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.154106 Aug 31 05:25:20.754809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 385/766] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:20 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:21.412236 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:21.412731 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:21.413553 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:21.414385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:21.419698 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:21.420203 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:21.420615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:21.420777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:21.421144 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:21.421261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:21.421597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:21.421743 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:21.422101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:21.422291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:21.422750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:21.423163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:21.631478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:21.634607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:21.640721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4fb74c15-67f3-4d43-b445-a11a5e037429 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.232538 Aug 31 05:25:21.641706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 386/767] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:21 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:21.643616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bd31507e-18e5-459d-90dc-cb162da049f4 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.238153 Aug 31 05:25:21.644488 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 382/768] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:21 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:21.777117 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:21.777709 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:21.783946 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:21.784422 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:21.784841 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:21.785490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:21.785929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:21.786370 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:22.337136 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:22.345594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:22.347010 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:22.348182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-085afe30-e42e-4328-8431-975b8e40197c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1722 microversion: 2.20 time: 0.575061 Aug 31 05:25:22.348745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 387/769] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:21 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1722 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:22.664583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:22.665146 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:22.665547 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:22.665654 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:22.672081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:22.672564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:22.672911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:22.673052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:22.673396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:22.673663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:22.673822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:22.674130 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:22.674742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:22.674872 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:22.675163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:22.675919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:22.929264 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:22.937415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5b78e3d0-8a5b-47cf-8aeb-cb52478efc56 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.276588 Aug 31 05:25:22.938427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 388/770] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:22 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:22.953247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:22.964536 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5d527198-4e89-48ca-ab6b-0c8f48f829a8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.303766 Aug 31 05:25:22.965198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 383/771] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:22 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:23.362941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-8646ab42-d68d-4970-8745-0f914af5fea9 req-7db07082-280e-469c-839e-25466424c294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b209be4-6027-4328-a956-5deea7de1a64", "name": "network-vif-deleted", "tag": "918fbec4-f9a6-4f49-98c8-ddb91a52e37a"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:23.373192 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:23.373756 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8646ab42-d68d-4970-8745-0f914af5fea9 req-7db07082-280e-469c-839e-25466424c294 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:23.374273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8646ab42-d68d-4970-8745-0f914af5fea9 req-7db07082-280e-469c-839e-25466424c294 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:23.374613 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:23.374733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8646ab42-d68d-4970-8745-0f914af5fea9 req-7db07082-280e-469c-839e-25466424c294 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:23.382237 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:23.382794 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:23.383288 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:23.384040 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:23.384548 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:23.385026 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:23.388873 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-8646ab42-d68d-4970-8745-0f914af5fea9 req-7db07082-280e-469c-839e-25466424c294 service nova] Creating event network-vif-deleted:918fbec4-f9a6-4f49-98c8-ddb91a52e37a for instance 5b209be4-6027-4328-a956-5deea7de1a64 on hv-cinder-85220 Aug 31 05:25:23.394076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-8646ab42-d68d-4970-8745-0f914af5fea9 req-7db07082-280e-469c-839e-25466424c294 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095045 Aug 31 05:25:23.395121 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 389/772] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:23.455982 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:23.465013 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:23.467804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:23.469185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c4b5e96f-8eba-4e29-babd-90e3c4b4f30f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1655 microversion: 2.20 time: 0.100838 Aug 31 05:25:23.470368 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 384/773] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:23 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:23.965532 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:23.966578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:23.973076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:23.973529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:23.973975 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:23.974721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:23.975160 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:23.975561 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:23.990232 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:23.995357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:24.004681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:24.005163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:24.006731 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:24.007498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:24.009375 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:24.009979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:24.203447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:24.212226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-115f7bd3-2419-46fc-aee5-d5447d2a87ee tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.251802 Aug 31 05:25:24.212948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 390/774] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:23 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:25:24.233871 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:24.242972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-aca94855-bb42-48c3-b781-18553ae51285 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.258826 Aug 31 05:25:24.243543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 385/775] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:23 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:24.493425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:24.494746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:24.503548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:24.504029 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:24.505009 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:24.505895 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:24.506361 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:24.506766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:24.542684 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:24.543193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:24.543609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:24.544065 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lazy-loading 'fault' on Instance uuid 5b209be4-6027-4328-a956-5deea7de1a64 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:25:24.584998 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:24.593559 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:24.595057 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:24.596201 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f530ff56-9386-4175-8400-d0f72afb757e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1370 microversion: 2.20 time: 0.107204 Aug 31 05:25:24.603021 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 391/776] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:24 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:25.236360 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:25.236986 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:25.245383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:25.245954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:25.246404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:25.247072 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:25.247492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:25.247898 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:25.264262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:25.264853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:25.271878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:25.272348 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:25.272775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:25.273423 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:25.274111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:25.274518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:25.445447 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:25.451731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:25.453871 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e5248b40-5068-4c27-8ac1-58ac85f00e36 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.223384 Aug 31 05:25:25.454858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 386/777] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:25 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:25.463669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f2c61c0b-6e78-4dc5-b3b4-4e78a4672521 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.203301 Aug 31 05:25:25.464237 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 392/778] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:25 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:25.619927 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:25.620545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:25.627095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:25.627572 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:25.627995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:25.628663 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:25.629084 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:25.629520 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:25.661818 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:25.662418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:25.662866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:25.663296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lazy-loading 'fault' on Instance uuid 5b209be4-6027-4328-a956-5deea7de1a64 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:25:25.707499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:25.716439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:25.717857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:25.719050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4c35aecb-eea2-4604-9e04-954e55662160 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 200 len: 1370 microversion: 2.20 time: 0.103267 Aug 31 05:25:25.719615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 387/779] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:25 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:26.483152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:26.483769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:26.485169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:26.486274 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:26.492502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:26.493097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:26.493631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:26.494319 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:26.495018 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:26.495274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:26.495436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:26.495904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:26.496130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:26.496513 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:26.496623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:26.496965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:26.697214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:26.701083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:26.705832 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-47cc291c-42b1-4bfd-be61-6163f3326224 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.224656 Aug 31 05:25:26.706460 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 388/780] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:26 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:26.709003 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-971a7248-f641-44ee-9b99-e5350260bb58 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.237213 Aug 31 05:25:26.709557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 393/781] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:26 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:26.741825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:26.742432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:26.748481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:26.748944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:26.749366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:26.750107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:26.750483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:26.750888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:26.764334 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] HTTP exception thrown: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Request method failure captured: Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 HTTP/1.1 Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu84xo3gecsnKPoBabsYGq6KYPt3W-SSu8Y6_k7eNJeGmchEsdfNHYL0dLj4QK5SU6AxHYUoCdZmgGxrWt-qAKQgYCs_cYQNoOZ4Ix8nK-Ox78xxbCpqZkZcBRr9D_RPwvQGiOcQewodxnrEUBI-pfpUgqCuQwR_Dzo8A3xgMWGiF5w Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:25:26.765943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_164c57b95c274f89bd391cf111efa374", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/164c57b95c274f89bd391cf111efa374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: af50ca6347404cdf8eb213d27053af16 Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:25:26.767660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '5b209be4-6027-4328-a956-5deea7de1a64'} Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:25:26.768583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:25:26.770144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:25:26.771729 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Returning 404 to user: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:25:26.771729 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-04557ed3-1038-413d-8113-7b2a0724da08 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 404 len: 111 microversion: 2.20 time: 0.029323 Aug 31 05:25:26.771729 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 389/782] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:26 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:25:26.776455 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2ec7f02c-d378-4632-afbf-f5284fd71bc7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '.version_select at 0x7fbd0ebdfa60>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:26.802537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2ec7f02c-d378-4632-afbf-f5284fd71bc7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475708473" status: 204 len: 0 microversion: 2.20 time: 0.030010 Aug 31 05:25:26.803165 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 394/783] 10.222.0.36 () {60 vars in 1259 bytes} [Wed Aug 31 05:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475708473 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 05:25:27.473256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5ba1de3b-e063-4c53-aadf-a68f6294cc8a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'create', calling method: .version_select at 0x7fbd0ebfac10>, body: {"keypair": {"name": "tempest-keypair-354118219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcPJPLHBI+XtZx2wmxKIJXu479Ce25fqKL2rFKzTM1dLI1+kgMhkLLqRj2F/i5K5TrkBHaqyAX522I2Ttw6Cu9tftQhufGoQFTo0mst2V0iLGMqwvsEZ3hLS27shqdOmg=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:27.490528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-5ba1de3b-e063-4c53-aadf-a68f6294cc8a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Getting quotas for project 164c57b95c274f89bd391cf111efa374. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:25:27.494609 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-5ba1de3b-e063-4c53-aadf-a68f6294cc8a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Getting quotas for user af50ca6347404cdf8eb213d27053af16 and project 164c57b95c274f89bd391cf111efa374. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:25:27.519080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5ba1de3b-e063-4c53-aadf-a68f6294cc8a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049670 Aug 31 05:25:27.519624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 390/784] 10.222.0.36 () {62 vars in 1200 bytes} [Wed Aug 31 05:25:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 05:25:27.728308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:27.729047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:27.732664 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:27.733255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:27.736682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:27.736682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:27.737252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:27.737999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:27.738630 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:27.739026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:27.740235 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:27.740971 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:27.741388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:27.742263 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:27.742696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:27.743087 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:27.957331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:27.961805 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:27.968680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9dd145de-bf53-4f18-8e44-4fcf14dd1465 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.240080 Aug 31 05:25:27.969307 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 391/785] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:27 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:25:27.970639 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2cd72f17-376d-410d-8346-aa0404e548bc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1734 microversion: 2.1 time: 0.247163 Aug 31 05:25:27.971422 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 395/786] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:27 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1734 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:28.859883 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1834338951", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b1ab71e-eadb-41b5-9cb1-69b3694afd1a"}], "security_groups": [{"name": "tempest-securitygroup--906690538"}], "key_name": "tempest-keypair-354118219", "user_data": "}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:28.978313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.network.neutron [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] validate_networks() for [('2b1ab71e-eadb-41b5-9cb1-69b3694afd1a', None, None, None, None, None)] {{(pid=120607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:25:28.990598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:28.991233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:28.998311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:28.998792 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:28.999214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:28.999898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.000339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.000754 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.004962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:29.187589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:29.195782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-73baba02-36bf-4d2b-8847-643218cfcea2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.209029 Aug 31 05:25:29.196362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 396/787] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:28 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:29.200923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:29.201522 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:29.207392 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.207870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.208287 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.209009 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.209487 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.209899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.420134 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:29.428936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-77d11b77-d344-46ef-b63c-5a7b3c9f4039 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1714 microversion: 2.1 time: 0.231542 Aug 31 05:25:29.429520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 397/788] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:29 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1714 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:29.491226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:29.491707 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:29.499825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.500310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.500734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.501429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.501870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.502323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.506494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Flavor limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:25:29.506889 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Image limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:25:29.507373 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Flavor pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:25:29.507764 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Image pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:25:29.508138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:25:29.517493 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.517958 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.518544 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.519248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.519678 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.520083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.536810 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Getting quotas for project 164c57b95c274f89bd391cf111efa374. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:25:29.540945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Getting quotas for user af50ca6347404cdf8eb213d27053af16 and project 164c57b95c274f89bd391cf111efa374. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:25:29.552291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Going to run 1 instances... {{(pid=120607) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:25:29.554626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:25:29.607313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-364d1c69-dee7-43d0-9e69-9c21ea3a795d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.751803 Aug 31 05:25:29.607979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 392/789] 10.222.0.36 () {62 vars in 1188 bytes} [Wed Aug 31 05:25:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 05:25:29.618987 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9e0db8dd-88c2-401b-a39f-76a0eb0b8aa3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:29.619616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9e0db8dd-88c2-401b-a39f-76a0eb0b8aa3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:29.646147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] HTTP exception thrown: Cannot 'detach_volume' instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 while it is in vm_state rescued Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Request method failure captured: Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments/f9df65da-7f16-4604-9c0b-7d687511e782 HTTP/1.1 Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu-pXJKIoDquy7frIjf6367HIYV4ywuMw9eIzUQ6pzxxOdOscxvrbuNl8dNXf_pCV50S3c0EluZ2OXqtHTC_CSyU5WlJJy0Euo8B4JbRS7RkLLOWn5LU7NuhHi-jr4y8w6V2MalJ01NkQGCIFlhDqekMGoOhFD-_toDGqryfBR34-4A Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 597fddc7874a4133987f79807674561f Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:25:29.647825 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_597fddc7874a4133987f79807674561f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/597fddc7874a4133987f79807674561f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 597fddc7874a4133987f79807674561f Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 806b011517ef4201a86c90472e0740d6 Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:25:29.649388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Cannot 'detach_volume' instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 while it is in vm_state rescued Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'server_id': '2a5a34a1-208a-4c29-b73f-70cfdb2e7979', 'id': 'f9df65da-7f16-4604-9c0b-7d687511e782'} Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:25:29.655143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 while it is in vm_state rescued Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 while it is in vm_state rescued Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:25:29.656548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Returning 409 to user: Cannot 'detach_volume' instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 while it is in vm_state rescued {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:25:29.657723 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9570b0d3-6283-4468-b125-2ff8a7cb2847 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments/f9df65da-7f16-4604-9c0b-7d687511e782" status: 409 len: 152 microversion: 2.1 time: 0.162091 Aug 31 05:25:29.657723 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 398/790] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:25:29 2022] DELETE /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments/f9df65da-7f16-4604-9c0b-7d687511e782 => generated 152 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 05:25:29.658217 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:29.658938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:29.667999 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.668594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.669019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.669718 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.670200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.670607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.685406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e0db8dd-88c2-401b-a39f-76a0eb0b8aa3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:29.695065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e0db8dd-88c2-401b-a39f-76a0eb0b8aa3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:29.697625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e0db8dd-88c2-401b-a39f-76a0eb0b8aa3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:29.698746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9e0db8dd-88c2-401b-a39f-76a0eb0b8aa3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1281 microversion: 2.20 time: 0.083630 Aug 31 05:25:29.700114 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 393/791] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:29 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:29.739870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0c7bd148-69d0-4f9a-ad94-48ab5a53b12f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "POST /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/action" status: 202 len: 0 microversion: 2.1 time: 0.085328 Aug 31 05:25:29.740530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 399/792] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:25:29 2022] POST /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:25:29.748795 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:29.749464 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:29.755719 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.756928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.757737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.758095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:29.758584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:29.759055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:29.897876 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:29.907709 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c7e8d99a-1174-4ea7-9434-195183c91a35 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1722 microversion: 2.1 time: 0.162876 Aug 31 05:25:29.908289 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 394/793] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:29 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:30.223029 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:30.223984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:30.231806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:30.232274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:30.232690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:30.233362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:30.233799 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:30.234245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:30.373270 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:30.381317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b478c50c-3cc2-4495-8f64-fc2e2a31a8b5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.166524 Aug 31 05:25:30.381884 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 400/794] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:30 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:30.722320 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:30.723064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:30.731017 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:30.731786 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:30.732223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:30.733764 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:30.734267 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:30.734723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:30.802861 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:30.811941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:30.813541 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:30.814807 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0058e6bb-46d0-43fb-b37f-90e189dc4cc3 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1333 microversion: 2.20 time: 0.096692 Aug 31 05:25:30.815846 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 395/795] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:30 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:30.929075 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:30.929771 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:30.937317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:30.937799 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:30.938288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:30.938988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:30.939472 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:30.940066 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:31.080531 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:31.089011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-877e6545-89d4-43d8-81e5-9a6dfc57436f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1722 microversion: 2.1 time: 0.163970 Aug 31 05:25:31.089554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 401/796] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:30 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:31.403720 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:31.404971 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:31.412366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:31.413104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:31.413750 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:31.414624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:31.415211 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:31.415798 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:31.607933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:31.616163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-07b711c8-1bfc-4e25-8c94-b995b315eecc tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.216652 Aug 31 05:25:31.624475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 396/797] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:31 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:31.837224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:31.837834 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:31.844478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:31.845194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:31.845798 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:31.846627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:31.847085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:31.847495 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:32.110709 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:32.111206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:32.117406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:32.117874 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:32.118315 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:32.118995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:32.119422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:32.119817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:32.124184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:32.170282 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:32.178621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:32.180005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:32.181072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f74f8d94-5255-4777-b8b4-1d0d1eae24e1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1339 microversion: 2.20 time: 0.348006 Aug 31 05:25:32.181648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 402/798] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:31 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1339 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:32.334593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:32.343099 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e606d484-89ae-40a2-8dc6-fd3ab05017f3 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1722 microversion: 2.1 time: 0.236343 Aug 31 05:25:32.347288 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 397/799] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:32 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:25:32.637070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:32.637672 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:32.644129 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:32.644610 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:32.645029 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:32.645714 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:32.646224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:32.647090 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:32.782218 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:32.790039 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-853797b5-953e-42a8-80f4-3c8d446d384c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.156942 Aug 31 05:25:32.790608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 403/800] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:32 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:33.202956 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:33.203537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:33.206914 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:33.210744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:33.211217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:33.211637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:33.212389 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:33.212808 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:33.213210 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:33.256478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-014990a2-7c31-4961-94c4-123b3ae0f2d6 req-b066a243-63c6-4a6e-913d-a3ece0fafe92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84115827-b1df-419c-b693-8b9105afcbbd", "name": "network-vif-plugged", "status": "completed", "tag": "3a5ee679-8365-4a8d-a3d4-4874a75745af"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:33.267268 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-014990a2-7c31-4961-94c4-123b3ae0f2d6 req-b066a243-63c6-4a6e-913d-a3ece0fafe92 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:33.267693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-014990a2-7c31-4961-94c4-123b3ae0f2d6 req-b066a243-63c6-4a6e-913d-a3ece0fafe92 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:33.268114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-014990a2-7c31-4961-94c4-123b3ae0f2d6 req-b066a243-63c6-4a6e-913d-a3ece0fafe92 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:33.280158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-014990a2-7c31-4961-94c4-123b3ae0f2d6 req-b066a243-63c6-4a6e-913d-a3ece0fafe92 service nova] Creating event network-vif-plugged:3a5ee679-8365-4a8d-a3d4-4874a75745af for instance 84115827-b1df-419c-b693-8b9105afcbbd on hv-cinder-85220 Aug 31 05:25:33.285404 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-014990a2-7c31-4961-94c4-123b3ae0f2d6 req-b066a243-63c6-4a6e-913d-a3ece0fafe92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032738 Aug 31 05:25:33.286226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 404/801] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:33.349569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:33.358113 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:33.359557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:33.360623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8806b070-e794-427d-bc2b-5f95bd657e30 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.161668 Aug 31 05:25:33.361180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 398/802] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:33 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:33.364630 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:33.365349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:33.371793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:33.372266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:33.372777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:33.373453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:33.373895 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:33.374312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:33.520039 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:33.529124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6d4c4e99-22ff-4cd4-b1da-bd827f8d7066 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1722 microversion: 2.1 time: 0.168656 Aug 31 05:25:33.529694 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 405/803] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:33 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:25:33.810970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:33.811571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:33.817813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:33.818334 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:33.818742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:33.819453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:33.819882 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:33.820291 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:34.081949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:34.090024 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d7e039d9-4a0c-4b19-9cdc-afebe8ea12c2 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.282917 Aug 31 05:25:34.090623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 399/804] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:33 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:34.382829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:34.383534 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:34.389709 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:34.390243 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:34.390665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:34.391345 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:34.391790 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:34.392200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:34.447801 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-a2358697-a828-486c-9a7c-a93992453a9c req-c5620f54-ac6f-45cf-9f33-ad3fb71400d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9517a7-1d14-4db3-ab98-835b298e1ab8", "tag": "fe7680cd-fd6f-4c92-b9ab-5050c6819de0"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:34.458047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a2358697-a828-486c-9a7c-a93992453a9c req-c5620f54-ac6f-45cf-9f33-ad3fb71400d8 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:34.458534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a2358697-a828-486c-9a7c-a93992453a9c req-c5620f54-ac6f-45cf-9f33-ad3fb71400d8 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:34.460423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a2358697-a828-486c-9a7c-a93992453a9c req-c5620f54-ac6f-45cf-9f33-ad3fb71400d8 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:34.470657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-a2358697-a828-486c-9a7c-a93992453a9c req-c5620f54-ac6f-45cf-9f33-ad3fb71400d8 service nova] Creating event network-changed:fe7680cd-fd6f-4c92-b9ab-5050c6819de0 for instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 on hv-cinder-85220 Aug 31 05:25:34.475730 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-a2358697-a828-486c-9a7c-a93992453a9c req-c5620f54-ac6f-45cf-9f33-ad3fb71400d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031685 Aug 31 05:25:34.476897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 400/805] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:34.550825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:34.551508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:34.558197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:34.558697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:34.559103 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:34.559783 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:34.560222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:34.560616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:34.564182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:34.572453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:34.573961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:34.575181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8c28b71f-22a2-4446-8d73-8e2e62f739aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.196381 Aug 31 05:25:34.575899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 406/806] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:34 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:34.702852 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:34.711427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-89ae4c41-f4ff-4b25-9e63-272cea01dc03 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1728 microversion: 2.1 time: 0.164871 Aug 31 05:25:34.712031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 401/807] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:34 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:34.732193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:34.732670 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:34.738984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:34.739481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:34.739871 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:34.740656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:34.741110 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:34.741523 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:34.871194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a384ab8c-30ad-4a44-9d46-9f5d299466af tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142776 Aug 31 05:25:34.871789 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 407/808] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 05:25:34 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:35.112204 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:35.112910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:35.119570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:35.120123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:35.120622 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:35.121397 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:35.121905 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:35.122420 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:35.258700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:35.266897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-30382466-1af4-4512-a7c4-fbcc9b07342c tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.158574 Aug 31 05:25:35.267593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 402/809] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:35 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:35.597226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:35.598044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:35.605507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:35.605991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:35.606468 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:35.607124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:35.607602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:35.608014 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:35.754169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:35.762573 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:35.764100 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:35.765246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a564e4d5-d137-470a-8ec6-fdc3af29b706 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.172102 Aug 31 05:25:35.765804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 408/810] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:35 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:36.082396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-ac8f0938-58b3-44f5-b846-3dbff72f9ff9 req-f2d9a0db-b34a-4e4e-836f-fda117b70b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a5a34a1-208a-4c29-b73f-70cfdb2e7979", "tag": "4d1c2526-a4f2-4a86-a757-af684a073abd"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:36.092681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-ac8f0938-58b3-44f5-b846-3dbff72f9ff9 req-f2d9a0db-b34a-4e4e-836f-fda117b70b74 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:36.093391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-ac8f0938-58b3-44f5-b846-3dbff72f9ff9 req-f2d9a0db-b34a-4e4e-836f-fda117b70b74 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:36.093813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-ac8f0938-58b3-44f5-b846-3dbff72f9ff9 req-f2d9a0db-b34a-4e4e-836f-fda117b70b74 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:36.107131 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-ac8f0938-58b3-44f5-b846-3dbff72f9ff9 req-f2d9a0db-b34a-4e4e-836f-fda117b70b74 service nova] Creating event network-changed:4d1c2526-a4f2-4a86-a757-af684a073abd for instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 on hv-cinder-85220 Aug 31 05:25:36.112252 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-ac8f0938-58b3-44f5-b846-3dbff72f9ff9 req-f2d9a0db-b34a-4e4e-836f-fda117b70b74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096456 Aug 31 05:25:36.113043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 403/811] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:36.287629 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:36.288381 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:36.294884 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:36.295389 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:36.295821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:36.296498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:36.297118 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:36.297691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:36.602233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:36.615458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e8144b4e-917a-4415-88e8-a171eff49076 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1576 microversion: 2.1 time: 0.331552 Aug 31 05:25:36.616008 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 409/812] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:36 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1576 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:36.788353 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:36.789040 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:36.795812 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:36.796300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:36.796721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:36.797403 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:36.797849 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:36.798304 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:36.927164 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:36.935871 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:36.937260 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:36.938380 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e49cc026-4d29-446a-89ef-a198116c33b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.154464 Aug 31 05:25:36.938940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 404/813] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:36 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:37.641345 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:37.642457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:37.646163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:37.655299 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:37.656110 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:37.656806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:37.657915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:37.658695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:37.659573 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:37.827989 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:37.840011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-31af3c38-d1de-4405-b86d-4182421c8e53 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1563 microversion: 2.1 time: 0.204933 Aug 31 05:25:37.840816 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 410/814] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:25:37 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:25:37.964989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:37.965777 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:37.976506 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:37.976993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:37.977451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:37.978163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:37.978607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:37.979020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:38.112262 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:38.121858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:38.123408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:38.124519 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-756fb27c-f345-4066-bbdc-11761f4b1cc8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.166237 Aug 31 05:25:38.125076 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 405/815] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:37 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:38.127453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-525beb45-22e3-4dc6-82e8-c3e8eecf38dd req-70d664e6-9bf9-42e7-b7bc-cba608ef2749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a5a34a1-208a-4c29-b73f-70cfdb2e7979", "tag": "4d1c2526-a4f2-4a86-a757-af684a073abd"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:38.137180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-525beb45-22e3-4dc6-82e8-c3e8eecf38dd req-70d664e6-9bf9-42e7-b7bc-cba608ef2749 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:38.137836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-525beb45-22e3-4dc6-82e8-c3e8eecf38dd req-70d664e6-9bf9-42e7-b7bc-cba608ef2749 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:38.138376 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-525beb45-22e3-4dc6-82e8-c3e8eecf38dd req-70d664e6-9bf9-42e7-b7bc-cba608ef2749 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:38.151651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-525beb45-22e3-4dc6-82e8-c3e8eecf38dd req-70d664e6-9bf9-42e7-b7bc-cba608ef2749 service nova] Creating event network-changed:4d1c2526-a4f2-4a86-a757-af684a073abd for instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 on hv-cinder-85220 Aug 31 05:25:38.156740 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-525beb45-22e3-4dc6-82e8-c3e8eecf38dd req-70d664e6-9bf9-42e7-b7bc-cba608ef2749 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033077 Aug 31 05:25:38.157309 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 411/816] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:25:39.151153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:39.152197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:39.163083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:39.164009 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:39.164432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:39.165107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:39.165563 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:39.165967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:39.298310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:39.310483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:39.312616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:39.314249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-59fa9fb5-854d-45c2-b50f-806674add913 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.169395 Aug 31 05:25:39.314922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 406/817] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:39 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:40.339239 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:40.339916 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:40.346592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:40.347093 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:40.347515 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:40.348193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:40.348635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:40.349045 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:40.487865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:40.496906 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:40.498354 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:40.499486 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-649517ee-832c-4530-8023-20fb795bc0bd tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.165592 Aug 31 05:25:40.500049 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 412/818] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:40 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:41.525312 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:41.526337 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:41.529433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:41.530731 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=12 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:41.540762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:41.540762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:41.541118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:41.541804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:41.542279 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:41.542692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:41.676453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:41.684993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:41.686444 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:41.687559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-47c832f4-6176-4c0c-8c15-8a4b3e7e7896 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.168971 Aug 31 05:25:41.688127 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 407/819] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:41 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:42.711285 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:42.711889 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:42.719614 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:42.720182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:42.720646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:42.721394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:42.721883 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:42.722373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:42.742481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:42.863643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:42.875955 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:42.878064 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:42.879973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-637a81ea-268e-40fa-93bb-f88c66320294 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.172964 Aug 31 05:25:42.880774 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 413/820] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:42 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:43.319175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-224a8d40-9b0d-43d1-8548-7e5cf8469f78 req-1acf48f5-43c0-4474-b713-ff4f162adece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9517a7-1d14-4db3-ab98-835b298e1ab8", "name": "network-vif-plugged", "status": "completed", "tag": "fe7680cd-fd6f-4c92-b9ab-5050c6819de0"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:43.330907 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-224a8d40-9b0d-43d1-8548-7e5cf8469f78 req-1acf48f5-43c0-4474-b713-ff4f162adece service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:43.331419 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-224a8d40-9b0d-43d1-8548-7e5cf8469f78 req-1acf48f5-43c0-4474-b713-ff4f162adece service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:43.332671 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-224a8d40-9b0d-43d1-8548-7e5cf8469f78 req-1acf48f5-43c0-4474-b713-ff4f162adece service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:43.345137 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-224a8d40-9b0d-43d1-8548-7e5cf8469f78 req-1acf48f5-43c0-4474-b713-ff4f162adece service nova] Creating event network-vif-plugged:fe7680cd-fd6f-4c92-b9ab-5050c6819de0 for instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 on hv-cinder-85220 Aug 31 05:25:43.350305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-224a8d40-9b0d-43d1-8548-7e5cf8469f78 req-1acf48f5-43c0-4474-b713-ff4f162adece service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034917 Aug 31 05:25:43.351244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 408/821] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:43.905699 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:43.906624 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:43.913645 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:43.914280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:43.914729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:43.915377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:43.915823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:43.916231 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:44.055401 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:44.064099 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:44.065536 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:44.066690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a70d2fe3-a125-4996-8fef-c265e82c78aa tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.166766 Aug 31 05:25:44.067262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 414/822] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:43 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:45.089516 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:45.090215 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:45.096977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:45.097446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:45.097858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:45.098561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:45.098989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:45.099394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:45.242530 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:45.255035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:45.257338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:45.259154 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9766934f-549b-436b-9fa4-9aedb235c8fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1406 microversion: 2.20 time: 0.173746 Aug 31 05:25:45.259971 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 409/823] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:45 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:46.285877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:46.286907 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:46.297803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:46.298542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:46.299248 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:46.300392 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:46.301102 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:46.301789 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:46.433212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:46.441462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:46.442917 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:25:46.444052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5bc51d2c-caf7-49a7-b194-c4f27f6076a8 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1598 microversion: 2.20 time: 0.164783 Aug 31 05:25:46.444580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 415/824] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:25:46 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:25:46.466728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:46.467248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:46.473789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:46.474308 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:46.474746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:46.475834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:46.476246 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:46.476718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:46.555587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d281ece9-a692-4f8f-9676-142af92f6184 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092954 Aug 31 05:25:46.556180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 410/825] 10.222.0.36 () {60 vars in 1316 bytes} [Wed Aug 31 05:25:46 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:25:47.740060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-a0fb93a6-c74d-443a-acc8-a75f5a929537 req-a10c9dd5-d5eb-4a2b-ae91-13163823718c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9517a7-1d14-4db3-ab98-835b298e1ab8", "tag": "fe7680cd-fd6f-4c92-b9ab-5050c6819de0"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:47.749711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a0fb93a6-c74d-443a-acc8-a75f5a929537 req-a10c9dd5-d5eb-4a2b-ae91-13163823718c service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:47.750211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a0fb93a6-c74d-443a-acc8-a75f5a929537 req-a10c9dd5-d5eb-4a2b-ae91-13163823718c service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:47.750637 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a0fb93a6-c74d-443a-acc8-a75f5a929537 req-a10c9dd5-d5eb-4a2b-ae91-13163823718c service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:47.761209 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-a0fb93a6-c74d-443a-acc8-a75f5a929537 req-a10c9dd5-d5eb-4a2b-ae91-13163823718c service nova] Creating event network-changed:fe7680cd-fd6f-4c92-b9ab-5050c6819de0 for instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 on hv-cinder-85220 Aug 31 05:25:47.766441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-a0fb93a6-c74d-443a-acc8-a75f5a929537 req-a10c9dd5-d5eb-4a2b-ae91-13163823718c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030007 Aug 31 05:25:47.767307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 416/826] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:57.155374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=24 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:57.156528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=68 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:57.163438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-606755977"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:57.164306 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:57.172101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:57.172574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:57.172997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:57.173667 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:57.174138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:57.174546 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:57.308604 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.network.security_group_api [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Removing security group 280b8ce2-f18c-4768-9916-73a03ec4e1d4 from port 0872e0da-1a2a-452d-a727-7f2804c96031 Aug 31 05:25:57.633371 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d3fbb41c-ac62-4dd5-b43d-ce3e7b818633 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "POST /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/action" status: 202 len: 0 microversion: 2.1 time: 0.480579 Aug 31 05:25:57.634022 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 411/827] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 05:25:57 2022] POST /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:25:57.642469 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-d542f620-12fb-4bd0-a43f-ec6cd632d337 req-179faf10-ea55-46f7-8647-dc978608461e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62c43e1-9843-4bb7-addd-98124c4f5425", "tag": "0872e0da-1a2a-452d-a727-7f2804c96031"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:57.653186 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d542f620-12fb-4bd0-a43f-ec6cd632d337 req-179faf10-ea55-46f7-8647-dc978608461e service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:57.653739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d542f620-12fb-4bd0-a43f-ec6cd632d337 req-179faf10-ea55-46f7-8647-dc978608461e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:57.654243 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-d542f620-12fb-4bd0-a43f-ec6cd632d337 req-179faf10-ea55-46f7-8647-dc978608461e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:57.666238 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-d542f620-12fb-4bd0-a43f-ec6cd632d337 req-179faf10-ea55-46f7-8647-dc978608461e service nova] Creating event network-changed:0872e0da-1a2a-452d-a727-7f2804c96031 for instance d62c43e1-9843-4bb7-addd-98124c4f5425 on hv-cinder-85220 Aug 31 05:25:57.671550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-d542f620-12fb-4bd0-a43f-ec6cd632d337 req-179faf10-ea55-46f7-8647-dc978608461e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033613 Aug 31 05:25:57.672176 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 417/828] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:58.708630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:58.709152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:58.710941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-099d158c-62e9-45f1-8f3d-af2250857839 req-abee3b5b-cc91-4eed-806f-49239e97c59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62c43e1-9843-4bb7-addd-98124c4f5425", "tag": "0872e0da-1a2a-452d-a727-7f2804c96031"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:25:58.715433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:58.715923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:58.716346 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:58.717025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:58.717467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:58.717873 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:58.721399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-099d158c-62e9-45f1-8f3d-af2250857839 req-abee3b5b-cc91-4eed-806f-49239e97c59f service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:58.722141 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-099d158c-62e9-45f1-8f3d-af2250857839 req-abee3b5b-cc91-4eed-806f-49239e97c59f service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:58.722796 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-099d158c-62e9-45f1-8f3d-af2250857839 req-abee3b5b-cc91-4eed-806f-49239e97c59f service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:58.734250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-099d158c-62e9-45f1-8f3d-af2250857839 req-abee3b5b-cc91-4eed-806f-49239e97c59f service nova] Creating event network-changed:0872e0da-1a2a-452d-a727-7f2804c96031 for instance d62c43e1-9843-4bb7-addd-98124c4f5425 on hv-cinder-85220 Aug 31 05:25:58.740094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-099d158c-62e9-45f1-8f3d-af2250857839 req-abee3b5b-cc91-4eed-806f-49239e97c59f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033512 Aug 31 05:25:58.740665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 418/829] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:25:58.810685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lazy-loading 'services' on Instance uuid d62c43e1-9843-4bb7-addd-98124c4f5425 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:25:58.890890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f029c455-98a5-48fe-ad37-ef9f26cf9d0c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments/f497df74-d325-4369-be25-86818ae7b6fb" status: 202 len: 0 microversion: 2.1 time: 0.186193 Aug 31 05:25:58.891527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 412/830] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:25:58 2022] DELETE /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments/f497df74-d325-4369-be25-86818ae7b6fb => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:25:58.904123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:58.906568 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:58.913188 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:58.914061 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:58.914649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:58.915455 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:58.916127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:58.916823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:58.958040 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c205efff-c21f-4096-bbfb-22049dede7bc tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060963 Aug 31 05:25:58.958888 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 419/831] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:25:58 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:25:59.974144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:25:59.977430 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:25:59.985749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:59.986408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:59.986965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:25:59.987843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:25:59.988422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:25:59.988969 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:00.020650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-176bc514-accc-444c-af61-f7b05d2a7168 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052860 Aug 31 05:26:00.021130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 413/832] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:25:59 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:01.037190 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:01.040631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:01.048031 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:01.048509 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:01.048933 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:01.049608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:01.050053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:01.050498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:01.079435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1e417255-255c-4da4-af04-f885f3a4501a tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048812 Aug 31 05:26:01.079983 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 420/833] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:26:01 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:26:01.091106 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:01.091624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:01.098136 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:01.098602 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:01.099018 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:01.099682 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:01.100428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:01.100826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:01.176260 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] HTTP exception thrown: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 is not attached to volume f497df74-d325-4369-be25-86818ae7b6fb Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Request method failure captured: Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments/f497df74-d325-4369-be25-86818ae7b6fb HTTP/1.1 Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu_rXiMO4mJIB0Q82pgyhMxDuCOg7SNjHEua9_QaXcjJETktxzrLXaE5TAXm0EAFt5Uzy8UA2Sdh4b-iOlp1PCJsrMQuMkNUlRmQ4DVPIEYhBVKG95_sQB8z_5uyUpxrdah1HAVH2Kuz_QecWy3YOZgtiV9LYU4kcX8DLk0K6Eq5fys Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 4ad69415b75d4d259c8cd31e05b2a505 Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-TestMinimumBasicScenario-367109060 Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:26:01.192910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ad69415b75d4d259c8cd31e05b2a505"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4ad69415b75d4d259c8cd31e05b2a505", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ad69415b75d4d259c8cd31e05b2a505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4ad69415b75d4d259c8cd31e05b2a505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-TestMinimumBasicScenario-367109060 Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 4ad69415b75d4d259c8cd31e05b2a505 Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-TestMinimumBasicScenario-367109060 Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-TestMinimumBasicScenario-367109060-project Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 57600fcb074741e782f0eda3ae51e6dd Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-TestMinimumBasicScenario-367109060-project Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:26:01.194515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 is not attached to volume f497df74-d325-4369-be25-86818ae7b6fb Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'server_id': 'd62c43e1-9843-4bb7-addd-98124c4f5425', 'id': 'f497df74-d325-4369-be25-86818ae7b6fb'} Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f497df74-d325-4369-be25-86818ae7b6fb. Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:26:01.195393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 is not attached to volume f497df74-d325-4369-be25-86818ae7b6fb Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 is not attached to volume f497df74-d325-4369-be25-86818ae7b6fb Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:01.196940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Returning 404 to user: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 is not attached to volume f497df74-d325-4369-be25-86818ae7b6fb {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:26:01.198175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ea53143b-1f41-466b-800d-0bce90a55c16 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments/f497df74-d325-4369-be25-86818ae7b6fb" status: 404 len: 154 microversion: 2.1 time: 0.107311 Aug 31 05:26:01.198175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 414/834] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:26:01 2022] DELETE /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425/os-volume_attachments/f497df74-d325-4369-be25-86818ae7b6fb => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:26:02.344242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:02.344745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:02.351788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:02.352260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:02.352676 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:02.353347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:02.353785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:02.354273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:02.378282 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:26:02.458362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5d35813b-67ae-4542-9f97-59efb2a3b50f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 204 len: 0 microversion: 2.1 time: 0.117271 Aug 31 05:26:02.459112 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 421/835] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:26:02 2022] DELETE /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:26:02.469545 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:02.470282 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:02.477471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:02.477939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:02.478384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:02.479144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:02.479578 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:02.480020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:02.641788 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:02.650038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-32ba4741-aabd-4e10-b512-e5df62d1b812 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1553 microversion: 2.1 time: 0.184850 Aug 31 05:26:02.650651 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 415/836] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:02 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:03.673864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:03.674704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:03.682135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:03.682747 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:03.683172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:03.683848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:03.684290 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:03.684698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:03.830153 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:03.842037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4c6f0640-ebc4-4e0f-94fe-b6c70f646cfd tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1553 microversion: 2.1 time: 0.173290 Aug 31 05:26:03.842750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 422/837] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:03 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:04.868003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:04.868570 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:04.876442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:04.877021 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:04.877514 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:04.878521 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:04.879105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:04.879631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:05.020883 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:05.029377 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c2f48533-7c97-451d-833a-cc9cc6613866 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1553 microversion: 2.1 time: 0.165359 Aug 31 05:26:05.029899 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 416/838] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:04 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:05.279145 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:05.281377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:05.288142 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:05.288621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:05.289044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:05.289760 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:05.290240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:05.290654 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:05.319297 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-25c043a0-b8ba-4041-81b6-6fda225c9a1c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044056 Aug 31 05:26:05.320215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 423/839] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:26:05 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:26:05.382589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:05.383080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:05.389041 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:05.389513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:05.389938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:05.390646 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:05.391090 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:05.391499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:05.416239 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Going to try to terminate instance {{(pid=120607) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:26:05.507375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-43edcb20-1505-4984-a8bf-c1e68bbe03a1 req-b4262e5b-9849-4370-97a2-7222de31fee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62c43e1-9843-4bb7-addd-98124c4f5425", "name": "network-vif-deleted", "tag": "0872e0da-1a2a-452d-a727-7f2804c96031"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:05.515026 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-889728de-e535-4127-baf2-3c97ea11403c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 204 len: 0 microversion: 2.1 time: 0.135198 Aug 31 05:26:05.515526 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 417/840] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:26:05 2022] DELETE /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:26:05.518759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-43edcb20-1505-4984-a8bf-c1e68bbe03a1 req-b4262e5b-9849-4370-97a2-7222de31fee7 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:05.519230 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-43edcb20-1505-4984-a8bf-c1e68bbe03a1 req-b4262e5b-9849-4370-97a2-7222de31fee7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:05.519698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-43edcb20-1505-4984-a8bf-c1e68bbe03a1 req-b4262e5b-9849-4370-97a2-7222de31fee7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:05.525415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:05.526286 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:05.531686 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-43edcb20-1505-4984-a8bf-c1e68bbe03a1 req-b4262e5b-9849-4370-97a2-7222de31fee7 service nova] Creating event network-vif-deleted:0872e0da-1a2a-452d-a727-7f2804c96031 for instance d62c43e1-9843-4bb7-addd-98124c4f5425 on hv-cinder-85220 Aug 31 05:26:05.533075 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:05.533572 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:05.533976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:05.535385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:05.535839 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:05.536249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:05.536645 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-43edcb20-1505-4984-a8bf-c1e68bbe03a1 req-b4262e5b-9849-4370-97a2-7222de31fee7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032900 Aug 31 05:26:05.537605 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 424/841] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:26:05.668180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:05.676476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3296af3c-16f4-449f-b67d-ab3aff8c74ed tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1672 microversion: 2.1 time: 0.155898 Aug 31 05:26:05.677099 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 418/842] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:05 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:06.055513 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:06.056492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:06.067088 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:06.067946 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:06.068644 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:06.069747 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:06.070538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:06.071218 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:06.138649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:06.146971 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c190c149-8bcd-4811-85c7-6a865649414f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1511 microversion: 2.1 time: 0.098619 Aug 31 05:26:06.147526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 425/843] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:06 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:06.698645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:06.699221 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:06.705680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:06.706208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:06.706631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:06.707294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:06.707732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:06.708137 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:06.842131 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:06.850468 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-374ec374-d2b2-4549-bac0-9472bcc3e230 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1672 microversion: 2.1 time: 0.155394 Aug 31 05:26:06.851033 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 419/844] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:06 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:07.167823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:07.168408 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:07.177065 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:07.177788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:07.178422 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:07.179484 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:07.179772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:07.180147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:07.211396 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:07.211874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:07.212296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:07.212728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lazy-loading 'fault' on Instance uuid d62c43e1-9843-4bb7-addd-98124c4f5425 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:26:07.281746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57600fcb074741e782f0eda3ae51e6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad69415b75d4d259c8cd31e05b2a505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:07.290510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-834f30d5-3b36-440e-aa72-ecc0ccaba340 tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 200 len: 1348 microversion: 2.1 time: 0.126661 Aug 31 05:26:07.291109 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 426/845] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:07 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 1348 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:07.871357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:07.871952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:07.878696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:07.879168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:07.879549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:07.880432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:07.880865 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:07.881269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:08.134962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:08.144224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fd107327-5f72-418f-bc27-0432fb13a69e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 200 len: 1605 microversion: 2.1 time: 0.276769 Aug 31 05:26:08.144910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 420/846] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:07 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 1605 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:08.210960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-3abfd7a5-aaf9-461c-9ebe-c89d60bf9f4a req-6b445a62-21d1-442e-8d31-f334e4f6df4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3104f831-5ba5-4ca1-a955-789bae89cb67", "name": "network-vif-deleted", "tag": "d4f7e7d3-760a-499d-bf03-a692cff2b439"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:08.219804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:08.225460 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3abfd7a5-aaf9-461c-9ebe-c89d60bf9f4a req-6b445a62-21d1-442e-8d31-f334e4f6df4a service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:08.226250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3abfd7a5-aaf9-461c-9ebe-c89d60bf9f4a req-6b445a62-21d1-442e-8d31-f334e4f6df4a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:08.226867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3abfd7a5-aaf9-461c-9ebe-c89d60bf9f4a req-6b445a62-21d1-442e-8d31-f334e4f6df4a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:08.244602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-3abfd7a5-aaf9-461c-9ebe-c89d60bf9f4a req-6b445a62-21d1-442e-8d31-f334e4f6df4a service nova] Creating event network-vif-deleted:d4f7e7d3-760a-499d-bf03-a692cff2b439 for instance 3104f831-5ba5-4ca1-a955-789bae89cb67 on hv-cinder-85220 Aug 31 05:26:08.250638 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-3abfd7a5-aaf9-461c-9ebe-c89d60bf9f4a req-6b445a62-21d1-442e-8d31-f334e4f6df4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043214 Aug 31 05:26:08.252121 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 427/847] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:08.312710 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:08.313569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] [instance: d62c43e1-9843-4bb7-addd-98124c4f5425] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:08.320585 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:08.321299 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:08.321882 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:08.322756 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:08.323414 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:08.324003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:08.338217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] HTTP exception thrown: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 could not be found. Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Request method failure captured: Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 HTTP/1.1 Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu_rXiMO4mJIB0Q82pgyhMxDuCOg7SNjHEua9_QaXcjJETktxzrLXaE5TAXm0EAFt5Uzy8UA2Sdh4b-iOlp1PCJsrMQuMkNUlRmQ4DVPIEYhBVKG95_sQB8z_5uyUpxrdah1HAVH2Kuz_QecWy3YOZgtiV9LYU4kcX8DLk0K6Eq5fys Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 4ad69415b75d4d259c8cd31e05b2a505 Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-TestMinimumBasicScenario-367109060 Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:26:08.340374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ad69415b75d4d259c8cd31e05b2a505"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4ad69415b75d4d259c8cd31e05b2a505", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4ad69415b75d4d259c8cd31e05b2a505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4ad69415b75d4d259c8cd31e05b2a505"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-TestMinimumBasicScenario-367109060 Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 4ad69415b75d4d259c8cd31e05b2a505 Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-TestMinimumBasicScenario-367109060 Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-TestMinimumBasicScenario-367109060-project Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 57600fcb074741e782f0eda3ae51e6dd Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-TestMinimumBasicScenario-367109060-project Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 could not be found. Aug 31 05:26:08.341984 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': 'd62c43e1-9843-4bb7-addd-98124c4f5425'} Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 could not be found. Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:26:08.342961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 could not be found. Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 could not be found. Aug 31 05:26:08.344446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:08.346675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Returning 404 to user: Instance d62c43e1-9843-4bb7-addd-98124c4f5425 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:26:08.347684 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-424c1c6d-31fc-4cb2-a624-46fa0572492c tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425" status: 404 len: 111 microversion: 2.1 time: 0.038860 Aug 31 05:26:08.348713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 421/848] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:08 2022] GET /compute/v2.1/servers/d62c43e1-9843-4bb7-addd-98124c4f5425 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:26:08.357770 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b85ee515-84fc-4b2c-b70e-3e702c2c0f8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] Calling method '.version_select at 0x7fbd0ec06040>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:08.379742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b85ee515-84fc-4b2c-b70e-3e702c2c0f8f tempest-TestMinimumBasicScenario-367109060 tempest-TestMinimumBasicScenario-367109060-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107287607" status: 202 len: 0 microversion: 2.1 time: 0.026197 Aug 31 05:26:08.380340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 428/849] 10.222.0.36 () {58 vars in 1269 bytes} [Wed Aug 31 05:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107287607 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:26:09.166706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:09.167249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:09.173685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:09.174187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:09.174607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:09.175283 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:09.175721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:09.176126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:09.189423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] HTTP exception thrown: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Request method failure captured: Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 HTTP/1.1 Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu80XnEtLwL5VXe40lnsTXrPaUxbDdK-7GucbvIhREHZBqiGEMSuvDqE1txS_g6vt_O4PpMjK2KIrMLGSV0uJFkWPwEdayS7WhRAAlWFjcbMhu3CwRQZ9msAvegRY9rpceBmPtCQKfwZG5z0Cz-aI_rsF8m2qOPdOKFAvmAYrJeM8w0 Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:26:09.191332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14058365e648441d96bb725c33f80923", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14058365e648441d96bb725c33f80923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 4b07cff5bc3a4e68b62c4c5d3e798732 Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:26:09.192685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '3104f831-5ba5-4ca1-a955-789bae89cb67'} Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:26:09.193498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:26:09.194761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:09.199960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Returning 404 to user: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:26:09.199960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ddb0109a-3abc-4b9f-a9e2-b47efcf9639c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 404 len: 111 microversion: 2.1 time: 0.030185 Aug 31 05:26:09.199960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 422/850] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:09 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:26:09.202341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-468dfce7-b24c-4e4c-8707-12f6b9e4a29c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '.version_select at 0x7fbd0ebb0820>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:09.224498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-468dfce7-b24c-4e4c-8707-12f6b9e4a29c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596219754" status: 202 len: 0 microversion: 2.1 time: 0.026315 Aug 31 05:26:09.225866 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 429/851] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 05:26:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596219754 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:26:09.899487 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ec40ad5a-3767-414b-a136-16e6b57f6499 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'create', calling method: .version_select at 0x7fbd0ea19b80>, body: {"keypair": {"name": "tempest-keypair-1946565613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESnCu7R0r6Ayg2UnY6MtbZBibgGQPL0eaQrP/A1hfhKU8JB6MH0NhsskvR7uGk8ET9413m7c1EkgM9ydqI3Wq5+oqKRS6S+zmmmiMBOwTgrS3lnpUR6CT6/v5rhyALq7Q=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:09.916409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-ec40ad5a-3767-414b-a136-16e6b57f6499 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Getting quotas for project 14058365e648441d96bb725c33f80923. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:26:09.921072 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-ec40ad5a-3767-414b-a136-16e6b57f6499 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Getting quotas for user 4b07cff5bc3a4e68b62c4c5d3e798732 and project 14058365e648441d96bb725c33f80923. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:26:09.950547 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ec40ad5a-3767-414b-a136-16e6b57f6499 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058026 Aug 31 05:26:09.951952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 423/852] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:26:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:11.763716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1688123123", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd8d1fc4-2d2b-4e66-9d1f-cafce5280c0d"}], "security_groups": [{"name": "tempest-securitygroup--1361960638"}], "key_name": "tempest-keypair-1946565613", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:11.892788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] validate_networks() for [('dd8d1fc4-2d2b-4e66-9d1f-cafce5280c0d', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:26:12.589587 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:26:12.590289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:26:12.590996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:26:12.591683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:26:12.592298 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:26:12.602026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:12.602617 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:12.603460 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:12.604796 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:12.605787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:12.606652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:12.631037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Getting quotas for project 14058365e648441d96bb725c33f80923. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:26:12.635494 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Getting quotas for user 4b07cff5bc3a4e68b62c4c5d3e798732 and project 14058365e648441d96bb725c33f80923. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:26:12.658834 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:26:12.661876 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:26:12.729545 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4de90a7d-5301-40eb-9149-ebd955bda3ea tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.970123 Aug 31 05:26:12.731320 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 430/853] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:26:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 05:26:12.742510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ade80e5b-2c7b-4880-98dd-2754bd68fd6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:12.743107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ade80e5b-2c7b-4880-98dd-2754bd68fd6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:12.887628 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ade80e5b-2c7b-4880-98dd-2754bd68fd6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:12.895143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ade80e5b-2c7b-4880-98dd-2754bd68fd6e tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1238 microversion: 2.1 time: 0.157205 Aug 31 05:26:12.898054 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 424/854] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:12 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1238 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:13.916936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:13.917491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:13.927812 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:13.928302 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:13.928728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:13.929432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:13.929855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:13.930473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:13.936259 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:14.005956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:14.013992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b81917bd-4cbb-4fc7-88d2-97c9659a35bb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1290 microversion: 2.1 time: 0.101757 Aug 31 05:26:14.014680 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 431/855] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:13 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:15.034475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:15.035180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:15.044626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:15.045265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:15.046136 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:15.047670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:15.048650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:15.049259 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:15.550416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:15.561247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5635e66b-4e2c-4fdf-8572-c47460d1ee2b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.530683 Aug 31 05:26:15.561979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 425/856] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:15 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:16.410386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-35f3b7bd-53c4-45d9-8801-7f87b53cc93b req-0416e21c-e622-4c74-a7c7-fb6b62605b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f9b586-a723-4308-ad75-4fadcfc03744", "tag": "6cc5a2fe-947c-4c64-83fd-68b0acd1384c"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:16.427331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-35f3b7bd-53c4-45d9-8801-7f87b53cc93b req-0416e21c-e622-4c74-a7c7-fb6b62605b94 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:16.428425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-35f3b7bd-53c4-45d9-8801-7f87b53cc93b req-0416e21c-e622-4c74-a7c7-fb6b62605b94 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:16.428879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-35f3b7bd-53c4-45d9-8801-7f87b53cc93b req-0416e21c-e622-4c74-a7c7-fb6b62605b94 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:16.441257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-35f3b7bd-53c4-45d9-8801-7f87b53cc93b req-0416e21c-e622-4c74-a7c7-fb6b62605b94 service nova] Creating event network-changed:6cc5a2fe-947c-4c64-83fd-68b0acd1384c for instance 92f9b586-a723-4308-ad75-4fadcfc03744 on hv-cinder-85220 Aug 31 05:26:16.447149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-35f3b7bd-53c4-45d9-8801-7f87b53cc93b req-0416e21c-e622-4c74-a7c7-fb6b62605b94 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040332 Aug 31 05:26:16.449312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 432/857] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:16.585135 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:16.585840 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:16.597064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:16.597604 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:16.598050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:16.598940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:16.600003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:16.600484 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:16.818083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:16.827908 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-629af8a7-dd69-40dc-916e-5e2a5885637c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.246659 Aug 31 05:26:16.828767 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 426/858] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:16 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:17.849915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:17.850719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:17.858065 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:17.858581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:17.859058 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:17.859760 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:17.860219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:17.860640 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:17.997697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:18.006137 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c0df69d7-aa9c-4bbf-97d6-a0f6e81cf865 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.160776 Aug 31 05:26:18.006696 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 433/859] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:17 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:19.030799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:19.031382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:19.038540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:19.039019 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:19.039444 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:19.040126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:19.040575 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:19.040988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:19.169398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:19.177449 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2725bb8d-3a09-40b5-bb29-e963b262f2ff tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.152603 Aug 31 05:26:19.178031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 427/860] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:19 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:20.202321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:20.202920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:20.210200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:20.210691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:20.211113 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:20.211801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:20.212242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:20.212649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:20.362166 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:20.370140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-65c1b383-20eb-4edc-a820-e6e614578793 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.173952 Aug 31 05:26:20.370710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 434/861] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:20 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:21.391526 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:21.392133 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:21.398663 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:21.399141 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:21.399567 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:21.400239 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:21.400670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:21.401075 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:21.537136 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:21.540963 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:21.546178 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-09a6d30a-5c10-44c1-a156-566c226f5b57 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.158781 Aug 31 05:26:21.546758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 428/862] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:21 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:22.571729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:22.572391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:22.580918 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:22.581378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:22.581834 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:22.582546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:22.582993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:22.583412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:22.616986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:22.649807 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:22.716306 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:22.724624 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bf2afb64-0a38-4d00-aadf-4e293c346506 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.160697 Aug 31 05:26:22.725189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 435/863] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:22 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:23.449512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-8129893f-1614-496d-aa20-503275757e5a req-b3240b94-1fe8-4f70-9fb5-e87a35cc8089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f9b586-a723-4308-ad75-4fadcfc03744", "name": "network-vif-plugged", "status": "completed", "tag": "6cc5a2fe-947c-4c64-83fd-68b0acd1384c"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:23.455598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:23.461390 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-8129893f-1614-496d-aa20-503275757e5a req-b3240b94-1fe8-4f70-9fb5-e87a35cc8089 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:23.461861 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-8129893f-1614-496d-aa20-503275757e5a req-b3240b94-1fe8-4f70-9fb5-e87a35cc8089 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:23.462326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-8129893f-1614-496d-aa20-503275757e5a req-b3240b94-1fe8-4f70-9fb5-e87a35cc8089 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:23.475242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-8129893f-1614-496d-aa20-503275757e5a req-b3240b94-1fe8-4f70-9fb5-e87a35cc8089 service nova] Creating event network-vif-plugged:6cc5a2fe-947c-4c64-83fd-68b0acd1384c for instance 92f9b586-a723-4308-ad75-4fadcfc03744 on hv-cinder-85220 Aug 31 05:26:23.480364 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-8129893f-1614-496d-aa20-503275757e5a req-b3240b94-1fe8-4f70-9fb5-e87a35cc8089 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 Aug 31 05:26:23.480957 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 429/864] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:23.745007 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:23.745643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:23.752581 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:23.753062 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:23.753503 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:23.754352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:23.754815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:23.755259 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:23.894470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:23.905091 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c234c28d-ce49-40b5-bc96-4afbc62c5020 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.163712 Aug 31 05:26:23.905743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 436/865] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:23 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:24.933366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:24.933947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:24.940694 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:24.941171 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:24.941594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:24.942305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:24.942741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:24.943151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:25.081518 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:25.090404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f199e476-275a-4017-9895-98d7df24f036 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1364 microversion: 2.1 time: 0.161942 Aug 31 05:26:25.090969 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 430/866] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:24 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:26.118768 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:26.119480 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:26.128005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:26.128601 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:26.129135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:26.130055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:26.130618 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:26.131139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:26.273335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:26.281421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6c341fb9-8014-4990-9210-2455387e9ccd tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1550 microversion: 2.1 time: 0.167907 Aug 31 05:26:26.282026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 437/867] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:26 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:26.301815 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:26.302385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:26.309283 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:26.309772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:26.310231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:26.310916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:26.311364 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:26.311784 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:26.390439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e35ca83d-2761-44c8-83dc-992c1bff3686 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092379 Aug 31 05:26:26.394662 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 431/868] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 05:26:26 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:27.347089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-68ad58bf-e79a-43c1-9d0e-1b24f2121813 req-ec6ee204-35b2-4da1-83d0-c2779fddcc67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f9b586-a723-4308-ad75-4fadcfc03744", "tag": "6cc5a2fe-947c-4c64-83fd-68b0acd1384c"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:27.357300 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-68ad58bf-e79a-43c1-9d0e-1b24f2121813 req-ec6ee204-35b2-4da1-83d0-c2779fddcc67 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:27.357771 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-68ad58bf-e79a-43c1-9d0e-1b24f2121813 req-ec6ee204-35b2-4da1-83d0-c2779fddcc67 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:27.358223 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-68ad58bf-e79a-43c1-9d0e-1b24f2121813 req-ec6ee204-35b2-4da1-83d0-c2779fddcc67 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:27.369593 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-68ad58bf-e79a-43c1-9d0e-1b24f2121813 req-ec6ee204-35b2-4da1-83d0-c2779fddcc67 service nova] Creating event network-changed:6cc5a2fe-947c-4c64-83fd-68b0acd1384c for instance 92f9b586-a723-4308-ad75-4fadcfc03744 on hv-cinder-85220 Aug 31 05:26:27.374899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-68ad58bf-e79a-43c1-9d0e-1b24f2121813 req-ec6ee204-35b2-4da1-83d0-c2779fddcc67 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031601 Aug 31 05:26:27.375537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 438/869] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:44.073450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:44.074272 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=12 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:44.078652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:44.079154 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:44.086521 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:44.086949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:44.087412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:44.088105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:44.088557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:44.088989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:44.184141 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lazy-loading 'services' on Instance uuid 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:26:44.263799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b60145dc-3feb-41f4-a9f2-36ae8d2661df tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments/f9df65da-7f16-4604-9c0b-7d687511e782" status: 202 len: 0 microversion: 2.1 time: 0.191706 Aug 31 05:26:44.264563 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 432/870] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:26:44 2022] DELETE /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments/f9df65da-7f16-4604-9c0b-7d687511e782 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:26:44.271651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:44.272399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=39 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:44.276957 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:44.279291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:44.287356 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:44.287827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:44.288245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:44.288922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:44.289358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:44.289763 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:44.320923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c758ffe9-dad9-4955-a8cd-f142beafadf0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051602 Aug 31 05:26:44.321682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 439/871] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:26:44 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:45.334670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:45.336962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:45.343262 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:45.343845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:45.344265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:45.344930 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:45.345369 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:45.345773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:45.376126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e25afede-7f72-4a15-8706-d49906f061db tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Aug 31 05:26:45.376658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 433/872] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:26:45 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:46.392429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:46.395275 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:46.403287 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:46.403802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:46.404335 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:46.405347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:46.405856 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:46.406357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:46.438472 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1fa5e9ce-da3e-4185-882a-618531d18c38 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052090 Aug 31 05:26:46.439245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 440/873] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:26:46 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:26:46.516187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:46.516781 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:46.523625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:46.524109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:46.524524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:46.525181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:46.525620 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:46.526029 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:46.551577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Going to try to terminate instance {{(pid=120607) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:26:46.628447 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f28a6605-ba56-42c9-bed7-25fe65c68a33 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 204 len: 0 microversion: 2.1 time: 0.116124 Aug 31 05:26:46.629248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 434/874] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:26:46 2022] DELETE /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:26:46.638649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:46.639450 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:46.646089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:46.646575 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:46.646997 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:46.647690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:46.648137 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:46.648580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:46.785677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:46.793735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-16ebe4fa-f91d-4c8f-841f-7faa9860c6c0 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1688 microversion: 2.1 time: 0.160308 Aug 31 05:26:46.794343 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 441/875] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:46 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:47.819857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:47.821011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:47.830438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:47.830916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:47.831334 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:47.832033 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:47.832466 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:47.832869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:47.964590 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:47.972454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-32258ca1-f680-423a-9cee-880842dbfe48 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1688 microversion: 2.1 time: 0.159681 Aug 31 05:26:47.973015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 435/876] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:47 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:49.001900 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:49.002960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:49.013556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:49.014398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:49.015095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:49.016246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:49.016986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:49.017664 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:49.156435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:49.164399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5a2d01de-09ea-4bb3-ab0f-1dc3f642ba0f tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1688 microversion: 2.1 time: 0.168983 Aug 31 05:26:49.164983 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 442/877] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:48 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:50.196861 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:50.197799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:50.206687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:50.207156 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:50.207572 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:50.208242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:50.208675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:50.209085 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:50.336508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:50.344490 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8a299d26-7c76-4f39-bcee-eb7026f55d6d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1688 microversion: 2.1 time: 0.154020 Aug 31 05:26:50.345056 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 436/878] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:50 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:51.365365 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:51.366032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:51.372587 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:51.373050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:51.373567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:51.374304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:51.374790 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:51.375243 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:51.496387 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:51.504709 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0703dfc1-56f3-4042-a497-d2007cce1d45 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 200 len: 1621 microversion: 2.1 time: 0.143110 Aug 31 05:26:51.505673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 443/879] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:51 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 1621 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:51.752595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-9ac86a37-306b-4362-8ec0-9d113b4e67bb req-df2cb95e-bba2-4c44-bbc8-20156ec7cdfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5a34a1-208a-4c29-b73f-70cfdb2e7979", "name": "network-vif-deleted", "tag": "4d1c2526-a4f2-4a86-a757-af684a073abd"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:51.761868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-9ac86a37-306b-4362-8ec0-9d113b4e67bb req-df2cb95e-bba2-4c44-bbc8-20156ec7cdfc service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:51.762692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-9ac86a37-306b-4362-8ec0-9d113b4e67bb req-df2cb95e-bba2-4c44-bbc8-20156ec7cdfc service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:51.763103 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-9ac86a37-306b-4362-8ec0-9d113b4e67bb req-df2cb95e-bba2-4c44-bbc8-20156ec7cdfc service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:51.775296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-9ac86a37-306b-4362-8ec0-9d113b4e67bb req-df2cb95e-bba2-4c44-bbc8-20156ec7cdfc service nova] Creating event network-vif-deleted:4d1c2526-a4f2-4a86-a757-af684a073abd for instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 on hv-cinder-85220 Aug 31 05:26:51.784564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-9ac86a37-306b-4362-8ec0-9d113b4e67bb req-df2cb95e-bba2-4c44-bbc8-20156ec7cdfc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036105 Aug 31 05:26:51.785166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 437/880] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:52.525054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:52.525678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 2a5a34a1-208a-4c29-b73f-70cfdb2e7979] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:52.532534 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:52.533056 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:52.533669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:52.534600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:52.535205 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:52.535801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:52.552240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] HTTP exception thrown: Instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 could not be found. Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Request method failure captured: Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 HTTP/1.1 Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu-pXJKIoDquy7frIjf6367HIYV4ywuMw9eIzUQ6pzxxOdOscxvrbuNl8dNXf_pCV50S3c0EluZ2OXqtHTC_CSyU5WlJJy0Euo8B4JbRS7RkLLOWn5LU7NuhHi-jr4y8w6V2MalJ01NkQGCIFlhDqekMGoOhFD-_toDGqryfBR34-4A Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 597fddc7874a4133987f79807674561f Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:26:52.553953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_597fddc7874a4133987f79807674561f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/597fddc7874a4133987f79807674561f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 597fddc7874a4133987f79807674561f Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 806b011517ef4201a86c90472e0740d6 Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 could not be found. Aug 31 05:26:52.555669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '2a5a34a1-208a-4c29-b73f-70cfdb2e7979'} Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 could not be found. Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:26:52.556538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 could not be found. Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 could not be found. Aug 31 05:26:52.557896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:26:52.559280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Returning 404 to user: Instance 2a5a34a1-208a-4c29-b73f-70cfdb2e7979 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:26:52.559280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ebd13cae-fae9-4714-bb7e-a3a86f08c13d tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979" status: 404 len: 111 microversion: 2.1 time: 0.034336 Aug 31 05:26:52.559280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 444/881] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:52 2022] GET /compute/v2.1/servers/2a5a34a1-208a-4c29-b73f-70cfdb2e7979 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:26:52.564782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0ca0f125-a23a-48e3-8275-1ec7c107aa9b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '.version_select at 0x7fbd0ec0e940>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:52.585644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0ca0f125-a23a-48e3-8275-1ec7c107aa9b tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043437905" status: 202 len: 0 microversion: 2.1 time: 0.025022 Aug 31 05:26:52.586246 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 438/882] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 05:26:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043437905 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:26:55.474387 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:55.474945 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:55.481544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:55.482035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:55.482476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:55.483388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:55.483592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:55.484156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:55.511599 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:26:55.602894 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-eda0340c-807d-4d49-8f95-ebbf9f170a58 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 204 len: 0 microversion: 2.1 time: 0.132402 Aug 31 05:26:55.604060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 445/883] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:26:55 2022] DELETE /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:26:55.614892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:55.616391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:55.624513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:55.625030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:55.625489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:55.626228 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:55.626676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:55.627087 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:55.763114 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:55.770908 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a1ffe5f7-f7d1-4ada-966d-26c7356fd8ba tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1507 microversion: 2.1 time: 0.162543 Aug 31 05:26:55.771480 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 439/884] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:55 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:26:56.793643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:56.794455 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:56.801434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:56.801929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:56.802375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:56.803052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:56.803490 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:56.803898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:57.031616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:57.039770 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-57a463eb-984c-4ccc-8a9e-4e84a9af1c22 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1507 microversion: 2.1 time: 0.250499 Aug 31 05:26:57.040349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 446/885] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:56 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:58.014465 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-6ff42ff8-7d87-4476-b0b6-bcd2c3dac24a req-8709c77d-e027-42c4-a4cb-32a289748935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed7b172-674e-4db9-ab55-7dccf7d89ec9", "name": "network-vif-deleted", "tag": "773bd3ad-05e1-4670-8cb8-c61eac5e26e9"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:26:58.025367 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-6ff42ff8-7d87-4476-b0b6-bcd2c3dac24a req-8709c77d-e027-42c4-a4cb-32a289748935 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:58.025950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-6ff42ff8-7d87-4476-b0b6-bcd2c3dac24a req-8709c77d-e027-42c4-a4cb-32a289748935 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:58.026295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-6ff42ff8-7d87-4476-b0b6-bcd2c3dac24a req-8709c77d-e027-42c4-a4cb-32a289748935 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:58.038382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-6ff42ff8-7d87-4476-b0b6-bcd2c3dac24a req-8709c77d-e027-42c4-a4cb-32a289748935 service nova] Creating event network-vif-deleted:773bd3ad-05e1-4670-8cb8-c61eac5e26e9 for instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 on hv-cinder-85220 Aug 31 05:26:58.044161 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-6ff42ff8-7d87-4476-b0b6-bcd2c3dac24a req-8709c77d-e027-42c4-a4cb-32a289748935 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Aug 31 05:26:58.044766 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 440/886] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:26:58.060292 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:58.060894 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:58.067542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:58.068017 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:58.068440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:58.069111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:58.069552 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:58.069962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:58.133982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:58.141824 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-61a85595-2f9a-4c0a-8c1a-e8ba15307565 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 200 len: 1292 microversion: 2.1 time: 0.085453 Aug 31 05:26:58.142437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 447/887] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:58 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:26:59.162797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:59.163502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: 3ed7b172-674e-4db9-ab55-7dccf7d89ec9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:59.169779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:59.170284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:59.170712 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:59.171388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:59.171824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:59.172234 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:59.185644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] HTTP exception thrown: Instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 could not be found. Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Request method failure captured: Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 HTTP/1.1 Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu-pXJKIoDquy7frIjf6367HIYV4ywuMw9eIzUQ6pzxxOdOscxvrbuNl8dNXf_pCV50S3c0EluZ2OXqtHTC_CSyU5WlJJy0Euo8B4JbRS7RkLLOWn5LU7NuhHi-jr4y8w6V2MalJ01NkQGCIFlhDqekMGoOhFD-_toDGqryfBR34-4A Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 597fddc7874a4133987f79807674561f Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:26:59.187270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_597fddc7874a4133987f79807674561f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/597fddc7874a4133987f79807674561f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 597fddc7874a4133987f79807674561f Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 806b011517ef4201a86c90472e0740d6 Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 could not be found. Aug 31 05:26:59.188877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '3ed7b172-674e-4db9-ab55-7dccf7d89ec9'} Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 could not be found. Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:26:59.189771 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 could not be found. Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 could not be found. Aug 31 05:26:59.191223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:26:59.192580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Returning 404 to user: Instance 3ed7b172-674e-4db9-ab55-7dccf7d89ec9 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:26:59.192580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c4dc449b-3df5-4d53-add9-66a6cfbf6c21 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9" status: 404 len: 111 microversion: 2.1 time: 0.030868 Aug 31 05:26:59.192580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 441/888] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:59 2022] GET /compute/v2.1/servers/3ed7b172-674e-4db9-ab55-7dccf7d89ec9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:26:59.197265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:59.197731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:59.204485 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:59.204993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:59.205413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:59.206119 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:59.206566 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:59.206977 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:59.234026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:26:59.324681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5736a4cf-96d8-4257-a0ef-8171d5ddc5f8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 204 len: 0 microversion: 2.1 time: 0.131047 Aug 31 05:26:59.325701 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 448/889] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:26:59 2022] DELETE /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:26:59.339046 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:26:59.339928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:26:59.350091 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:59.350924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:59.351454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:59.352240 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:26:59.352876 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:26:59.353437 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:26:59.491793 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:26:59.499761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b7b5e4d6-6f7e-41ad-a3ec-fddb9d67f208 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.167304 Aug 31 05:26:59.500350 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 442/890] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:26:59 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:27:00.523261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:00.524032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:00.531669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:00.532194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:00.532675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:00.533429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:00.533927 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:00.534428 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:00.668903 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:00.676964 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2deebc25-4691-484e-b073-f877625aeddc tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.159102 Aug 31 05:27:00.677510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 449/891] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:00 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:01.701163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:01.701910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:01.712215 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:01.712943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:01.713601 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:01.714687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:01.715978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:01.716618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:01.855481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:01.863242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3e675d43-1969-410e-b86c-bcace60f1797 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1520 microversion: 2.1 time: 0.168217 Aug 31 05:27:01.863803 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 443/892] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:01 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:02.709341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-19fcec15-743b-4c2b-9fab-b411e12b6fe0 req-c859a16d-5bb9-4817-9eff-ef5493922e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b72dc747-3be8-4092-b09d-1d6943280b33", "name": "network-vif-deleted", "tag": "23757f50-f4a3-4633-bbf5-0bb3ca5b5075"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:02.719237 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-19fcec15-743b-4c2b-9fab-b411e12b6fe0 req-c859a16d-5bb9-4817-9eff-ef5493922e66 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:02.719798 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-19fcec15-743b-4c2b-9fab-b411e12b6fe0 req-c859a16d-5bb9-4817-9eff-ef5493922e66 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:02.720215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-19fcec15-743b-4c2b-9fab-b411e12b6fe0 req-c859a16d-5bb9-4817-9eff-ef5493922e66 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:02.732069 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-19fcec15-743b-4c2b-9fab-b411e12b6fe0 req-c859a16d-5bb9-4817-9eff-ef5493922e66 service nova] Creating event network-vif-deleted:23757f50-f4a3-4633-bbf5-0bb3ca5b5075 for instance b72dc747-3be8-4092-b09d-1d6943280b33 on hv-cinder-85220 Aug 31 05:27:02.736782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-19fcec15-743b-4c2b-9fab-b411e12b6fe0 req-c859a16d-5bb9-4817-9eff-ef5493922e66 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031672 Aug 31 05:27:02.737592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 450/893] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:02.884618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:02.885214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:02.892321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:02.892803 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:02.893229 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:02.893912 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:02.894386 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:02.894876 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:02.926648 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:02.927214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:02.927666 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:02.928191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lazy-loading 'fault' on Instance uuid b72dc747-3be8-4092-b09d-1d6943280b33 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:27:02.973308 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806b011517ef4201a86c90472e0740d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597fddc7874a4133987f79807674561f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:02.988445 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ef2fd2e1-a899-41cb-839d-3d7d3fc744bd tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 200 len: 1311 microversion: 2.1 time: 0.107797 Aug 31 05:27:02.989071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 444/894] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:02 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:04.014880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:04.016015 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] [instance: b72dc747-3be8-4092-b09d-1d6943280b33] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:04.027386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:04.028176 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:04.028950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:04.030096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:04.030820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:04.031511 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:04.048738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] HTTP exception thrown: Instance b72dc747-3be8-4092-b09d-1d6943280b33 could not be found. Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Request method failure captured: Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 HTTP/1.1 Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu-pXJKIoDquy7frIjf6367HIYV4ywuMw9eIzUQ6pzxxOdOscxvrbuNl8dNXf_pCV50S3c0EluZ2OXqtHTC_CSyU5WlJJy0Euo8B4JbRS7RkLLOWn5LU7NuhHi-jr4y8w6V2MalJ01NkQGCIFlhDqekMGoOhFD-_toDGqryfBR34-4A Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 597fddc7874a4133987f79807674561f Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:27:04.050364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_597fddc7874a4133987f79807674561f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/597fddc7874a4133987f79807674561f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/597fddc7874a4133987f79807674561f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 597fddc7874a4133987f79807674561f Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-760762536 Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 806b011517ef4201a86c90472e0740d6 Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-760762536-project Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance b72dc747-3be8-4092-b09d-1d6943280b33 could not be found. Aug 31 05:27:04.051855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'b72dc747-3be8-4092-b09d-1d6943280b33'} Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b72dc747-3be8-4092-b09d-1d6943280b33 could not be found. Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:27:04.052772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b72dc747-3be8-4092-b09d-1d6943280b33 could not be found. Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b72dc747-3be8-4092-b09d-1d6943280b33 could not be found. Aug 31 05:27:04.054443 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:04.055871 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] Returning 404 to user: Instance b72dc747-3be8-4092-b09d-1d6943280b33 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:27:04.055871 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6fb1f075-f92b-42da-88e9-4762a2961fc8 tempest-ServerRescueNegativeTestJSON-760762536 tempest-ServerRescueNegativeTestJSON-760762536-project] 10.222.0.36 "GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33" status: 404 len: 111 microversion: 2.1 time: 0.043739 Aug 31 05:27:04.055871 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 451/895] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:04 2022] GET /compute/v2.1/servers/b72dc747-3be8-4092-b09d-1d6943280b33 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:27:05.940663 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:05.941264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:05.948408 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:05.949011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:05.949328 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:05.950381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:05.950827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:05.951211 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:05.976457 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-547724a6-071b-4ff5-9625-6e9ad235d604 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/ips" status: 200 len: 151 microversion: 2.20 time: 0.040138 Aug 31 05:27:05.977363 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 445/896] 10.222.0.36 () {60 vars in 1289 bytes} [Wed Aug 31 05:27:05 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:27:07.887478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:07.888284 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:07.895307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:07.895786 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:07.896208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:07.896973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:07.897397 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:07.897972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:07.921734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lazy-loading 'flavor' on Instance uuid 1d9517a7-1d14-4db3-ab98-835b298e1ab8 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:27:07.968304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:08.103359 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2b2ab522-3a3d-4a17-9702-d6ac2ba8bfde tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/action" status: 202 len: 0 microversion: 2.20 time: 0.219849 Aug 31 05:27:08.104013 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 452/897] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Aug 31 05:27:07 2022] POST /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:27:08.114313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:08.114313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:08.120715 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:08.121268 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:08.121686 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:08.122411 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:08.122976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:08.123528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:08.259170 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:08.267222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:08.268636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:08.269915 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2f69f5cf-233e-4071-b2ad-9d24924c806e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.161384 Aug 31 05:27:08.270501 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 446/898] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:08 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:09.294449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:09.295157 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:09.301838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:09.302694 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:09.303186 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:09.303959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:09.304606 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:09.305095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:09.444216 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:09.469088 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:09.470946 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:09.472489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-325ad438-12e2-412c-b6b7-00ad6634ca19 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.182899 Aug 31 05:27:09.486215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 453/899] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:09 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:10.497143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:10.497798 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:10.505135 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:10.505690 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:10.506218 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:10.506968 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:10.507478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:10.507963 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:10.668650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:10.679942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:10.681678 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:10.683267 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6d9be890-9197-4575-a494-2d86f26bfa9e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.190404 Aug 31 05:27:10.684004 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 447/900] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:10 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:11.707716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:11.710435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:11.717864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:11.718821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:11.719460 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:11.720571 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:11.721368 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:11.722146 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:11.970776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:11.981549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:11.982972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:11.984445 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ee3cdb15-ba87-400f-bdfc-e22cb83caa42 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.281528 Aug 31 05:27:11.999376 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 454/901] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:11 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:12.949753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e9cc3f40-bf66-4ce0-9855-42d235fd1c06 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: .version_select at 0x7fbd0eae94c0>, body: {"keypair": {"name": "tempest-keypair-689796341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeBfr0/kVdpiaojMjGk/yxAaMHq+iUfzxb5MRWmJzgWchgYSvsLfx3QpFKmwWvrcDOSF+fTnZxBTGKq5KnisVWBXeNZVvHbwvawLzPAh0aqxuduk/ygs56iRTIZyqKb2Q=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:12.966126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-e9cc3f40-bf66-4ce0-9855-42d235fd1c06 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:27:12.970096 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-e9cc3f40-bf66-4ce0-9855-42d235fd1c06 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for user b0f728c7e4074084be1a433ae14879b8 and project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:27:12.993739 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e9cc3f40-bf66-4ce0-9855-42d235fd1c06 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.228876 Aug 31 05:27:12.994406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 448/902] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:27:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:13.011760 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:13.012360 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:13.019076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:13.019601 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:13.020272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:13.021135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:13.021752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:13.022246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:13.215169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:13.248156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:13.256813 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:13.258053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-308b56bf-406a-4cb8-a844-4dba6142b588 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.250247 Aug 31 05:27:13.258613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 455/903] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:13 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:14.281416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:14.281989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:14.286822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:14.294608 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:14.295166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:14.295749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:14.296478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:14.297091 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:14.297573 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:14.302851 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:14.433714 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:14.442895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:14.444398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:14.445538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4e581d37-c9f9-43a6-88c1-98f96bb27206 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.168632 Aug 31 05:27:14.446112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 449/904] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:14 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:14.635173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-94483974", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "475a74f0-6918-4e96-839d-657934d65631"}], "security_groups": [{"name": "tempest-securitygroup--1668658414"}], "key_name": "tempest-keypair-689796341", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:14.644439 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:14.759331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] validate_networks() for [('475a74f0-6918-4e96-839d-657934d65631', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:27:15.148319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:27:15.148879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:27:15.149438 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:27:15.149899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:27:15.150395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:27:15.159528 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:15.160041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:15.160466 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:15.161176 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:15.161621 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:15.162051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:15.178814 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:27:15.182926 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for user b0f728c7e4074084be1a433ae14879b8 and project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:27:15.194549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:27:15.196851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:27:15.246357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a8f892c5-83d7-47bf-b2a7-6f96d467a5b2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614298 Aug 31 05:27:15.250155 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 456/905] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:27:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:27:15.255832 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cd7a14b3-b8a8-44c4-8a2b-dda12d71b066 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:15.256647 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cd7a14b3-b8a8-44c4-8a2b-dda12d71b066 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:15.326234 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cd7a14b3-b8a8-44c4-8a2b-dda12d71b066 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:15.336591 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cd7a14b3-b8a8-44c4-8a2b-dda12d71b066 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1239 microversion: 2.1 time: 0.084760 Aug 31 05:27:15.337566 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 450/906] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:15 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:27:15.468202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:15.469071 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:15.478671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:15.479327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:15.479962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:15.480850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:15.481474 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:15.482107 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:15.639731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:15.651116 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:15.653154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:15.654593 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a951d288-fc01-40c1-a684-5f23444bb566 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.190367 Aug 31 05:27:15.655222 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 457/907] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:15 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:16.356932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:16.358180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:16.366201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:16.366685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:16.367093 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:16.367779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:16.368435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:16.368850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:16.442778 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:16.459673 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-48e81953-0d35-49fa-b45c-6cda7ba6affe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1291 microversion: 2.1 time: 0.106045 Aug 31 05:27:16.460898 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 451/908] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:16 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1291 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:16.680954 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:16.681748 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:16.689246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:16.689958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:16.690444 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:16.691240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:16.691746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:16.692227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:16.904898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:16.915052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:16.917322 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:16.918720 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7622a1f6-4441-4e33-971b-1a16c3432178 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.244865 Aug 31 05:27:16.919365 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 458/909] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:16 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:17.480859 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:17.481561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:17.488621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:17.489177 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:17.489663 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:17.490442 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:17.491529 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:17.491529 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:17.734457 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:17.743849 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-448ec298-d95e-47d6-a06a-4ee0f9103a97 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.266866 Aug 31 05:27:17.744669 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 452/910] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:17 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:17.943713 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:17.944780 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:17.953508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:17.954561 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:17.956599 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:17.957602 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:17.957979 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:17.958512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.083774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-d22ea94b-4c4b-44c6-8d2d-6bbbb2d8094f req-ff348ad0-8834-4f84-801e-dbdee396f3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3", "tag": "8a7fc778-1730-48b9-b81b-87ca459e7396"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:18.098272 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-d22ea94b-4c4b-44c6-8d2d-6bbbb2d8094f req-ff348ad0-8834-4f84-801e-dbdee396f3f8 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:18.098877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-d22ea94b-4c4b-44c6-8d2d-6bbbb2d8094f req-ff348ad0-8834-4f84-801e-dbdee396f3f8 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:18.099542 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-d22ea94b-4c4b-44c6-8d2d-6bbbb2d8094f req-ff348ad0-8834-4f84-801e-dbdee396f3f8 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.112768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-d22ea94b-4c4b-44c6-8d2d-6bbbb2d8094f req-ff348ad0-8834-4f84-801e-dbdee396f3f8 service nova] Creating event network-changed:8a7fc778-1730-48b9-b81b-87ca459e7396 for instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 on hv-cinder-85220 Aug 31 05:27:18.117806 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-d22ea94b-4c4b-44c6-8d2d-6bbbb2d8094f req-ff348ad0-8834-4f84-801e-dbdee396f3f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045894 Aug 31 05:27:18.119013 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 453/911] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:18.184287 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:18.199223 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:18.200646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:18.201817 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cda1c3a5-276a-4da3-b6dc-3b5d7370b7fb tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.264366 Aug 31 05:27:18.202450 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 459/912] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:17 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:18.206142 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:18.206142 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:18.206846 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-8d7ad07a-91bb-4559-b1ad-cd4bdf91a541 req-90207565-eb1d-4f26-a94d-bb6600e40b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84115827-b1df-419c-b693-8b9105afcbbd", "tag": "3a5ee679-8365-4a8d-a3d4-4874a75745af"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:18.219299 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8d7ad07a-91bb-4559-b1ad-cd4bdf91a541 req-90207565-eb1d-4f26-a94d-bb6600e40b4a service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:18.220023 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8d7ad07a-91bb-4559-b1ad-cd4bdf91a541 req-90207565-eb1d-4f26-a94d-bb6600e40b4a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:18.221369 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:18.221369 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:18.221613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-8d7ad07a-91bb-4559-b1ad-cd4bdf91a541 req-90207565-eb1d-4f26-a94d-bb6600e40b4a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.221713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.222259 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:18.223022 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:18.223435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.234463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-8d7ad07a-91bb-4559-b1ad-cd4bdf91a541 req-90207565-eb1d-4f26-a94d-bb6600e40b4a service nova] Creating event network-changed:3a5ee679-8365-4a8d-a3d4-4874a75745af for instance 84115827-b1df-419c-b693-8b9105afcbbd on hv-cinder-85220 Aug 31 05:27:18.240096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-8d7ad07a-91bb-4559-b1ad-cd4bdf91a541 req-90207565-eb1d-4f26-a94d-bb6600e40b4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036503 Aug 31 05:27:18.240970 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 460/913] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:18.251421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Going to try to terminate instance {{(pid=120607) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:27:18.332261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-60523a0a-ec73-4ed5-9ff5-a06a1797197b tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 204 len: 0 microversion: 2.1 time: 0.136175 Aug 31 05:27:18.333120 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 454/914] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:27:18 2022] DELETE /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:27:18.343002 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:18.343936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:18.350545 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:18.351119 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:18.351619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.352434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:18.352976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:18.353476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.554375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:18.562889 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0bfdc57d-d404-45f0-a7ca-f7e2dd97e710 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.224905 Aug 31 05:27:18.563526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 461/915] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:18 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:18.765863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:18.766689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:18.773522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:18.773996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:18.774438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.775140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:18.775579 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:18.775962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:18.910421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:18.918298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9e9f902f-ab07-4abb-9204-be4e53aacfbc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.156694 Aug 31 05:27:18.918867 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 455/916] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:18 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:19.225333 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:19.225954 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:19.233333 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:19.233808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:19.234313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:19.235004 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:19.235585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:19.236018 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:19.370481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:19.378880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:19.380292 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:19.381452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8636d0c2-698a-4aa9-b001-f7ef2a9c0287 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.160497 Aug 31 05:27:19.381973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 462/917] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:19 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:19.587800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:19.588454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:19.595972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:19.596453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:19.597015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:19.598036 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:19.598474 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:19.598882 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:19.877047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:19.885376 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-36f4f2f7-c0db-4cd6-9bf1-03bc4ef8d8e8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.303645 Aug 31 05:27:19.886039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 456/918] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:19 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:19.939339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:19.939956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:19.946582 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:19.947055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:19.947473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:19.948139 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:19.948575 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:19.948979 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:20.082293 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:20.090352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-afe54538-ec88-420c-b767-7a6ea9aa70b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.154785 Aug 31 05:27:20.091098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 463/919] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:19 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:20.403885 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:20.404644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:20.411326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:20.411802 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:20.412226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:20.412906 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:20.413346 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:20.413734 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:20.582760 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:20.591259 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:20.592693 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:20.593851 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-22596cb3-5cf0-47d4-b737-b2167588a101 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.194292 Aug 31 05:27:20.594446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 457/920] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:20 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:20.911060 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:20.911961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:20.923055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:20.923851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:20.924497 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:20.925492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:20.925941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:20.926457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:21.061557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:21.071003 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-963132d3-84c9-4d1b-acb4-396d50d6a4c3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.166743 Aug 31 05:27:21.071569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 464/921] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:20 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:21.116917 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:21.117479 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:21.124089 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:21.124559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:21.124978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:21.125641 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:21.126098 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:21.126508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:21.271111 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:21.279086 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ca542020-1df2-45fc-9c95-e6dcd6229db7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.166068 Aug 31 05:27:21.279655 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 458/922] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:21 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:21.618041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:21.618656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:21.625059 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:21.625535 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:21.625961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:21.626667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:21.627110 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:21.627524 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:21.764616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:21.772787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:21.774274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:21.775426 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a38d0829-ce63-4d1a-9df2-adbe068ef113 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.161462 Aug 31 05:27:21.775983 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 465/923] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:21 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:22.105799 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:22.106577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:22.115691 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:22.116343 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:22.116980 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:22.117737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:22.118399 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:22.118995 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:22.255687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:22.264142 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9efa302a-7ac3-44ac-95a0-bcb6e5f247ec tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1569 microversion: 2.1 time: 0.165455 Aug 31 05:27:22.264722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 459/924] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:22 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:22.299985 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:22.300750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:22.307764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:22.308214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:22.308667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:22.309353 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:22.309797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:22.310244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:22.445332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:22.453612 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8db59c54-4c1b-4f46-85d5-41d44d2ab6ad tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.157507 Aug 31 05:27:22.454193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 466/925] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:22 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:22.800224 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:22.800822 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:22.809702 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:22.810219 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:22.810715 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:22.811398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:22.811833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:22.812239 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:23.093419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-61d98b39-af31-4a96-87f1-a36f817b3b46 req-b1a170e3-ab72-47ed-978a-8032f1902e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84115827-b1df-419c-b693-8b9105afcbbd", "name": "network-vif-deleted", "tag": "3a5ee679-8365-4a8d-a3d4-4874a75745af"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:23.104685 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-61d98b39-af31-4a96-87f1-a36f817b3b46 req-b1a170e3-ab72-47ed-978a-8032f1902e20 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:23.105147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-61d98b39-af31-4a96-87f1-a36f817b3b46 req-b1a170e3-ab72-47ed-978a-8032f1902e20 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:23.105556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-61d98b39-af31-4a96-87f1-a36f817b3b46 req-b1a170e3-ab72-47ed-978a-8032f1902e20 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:23.117416 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-61d98b39-af31-4a96-87f1-a36f817b3b46 req-b1a170e3-ab72-47ed-978a-8032f1902e20 service nova] Creating event network-vif-deleted:3a5ee679-8365-4a8d-a3d4-4874a75745af for instance 84115827-b1df-419c-b693-8b9105afcbbd on hv-cinder-85220 Aug 31 05:27:23.122835 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-61d98b39-af31-4a96-87f1-a36f817b3b46 req-b1a170e3-ab72-47ed-978a-8032f1902e20 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034011 Aug 31 05:27:23.123566 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 467/926] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:27:23.285634 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:23.286413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:23.293373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:23.293855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:23.294319 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:23.295005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:23.295446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:23.295861 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:23.363903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:23.374410 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:23.375833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:23.377168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cdcfb521-2d72-423b-8534-849165563bef tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.582551 Aug 31 05:27:23.392473 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 460/927] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:22 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:23.421690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:23.430616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e6fef9dc-e6da-45e5-8037-6fb47d5410d3 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1219 microversion: 2.1 time: 0.149104 Aug 31 05:27:23.431369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 468/928] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:23 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:23.474172 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:23.474786 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:23.481089 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:23.481556 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:23.481976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:23.482669 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:23.483306 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:23.483712 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:23.719925 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:23.733939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8c8e2aaa-7dd3-4e04-9bb7-20b537f8c3c3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.263982 Aug 31 05:27:23.734906 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 461/929] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:23 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:24.401087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:24.401703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:24.409181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:24.409861 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:24.410352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:24.411037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:24.411486 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:24.411901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:24.451695 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:24.452278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:24.459842 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:24.460631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:24.461213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:24.462204 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:24.462793 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:24.463355 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:24.497451 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:24.497924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:24.498368 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:24.498797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lazy-loading 'fault' on Instance uuid 84115827-b1df-419c-b693-8b9105afcbbd {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:27:24.552367 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0063b9fa5dc4c3789db536f99a211fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae98273d8d0040b39ed83c8b7aee74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:24.560532 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bd180129-2608-4d5d-93c7-cc7376e1c4ca tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 200 len: 1387 microversion: 2.1 time: 0.112683 Aug 31 05:27:24.561128 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 462/930] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:24 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 1387 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:24.575707 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:24.584554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:24.586110 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:24.587266 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4c0e5611-1d1b-4b12-96f2-6f9d7448c71b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.190753 Aug 31 05:27:24.587830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 469/931] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:24 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:24.758793 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:24.759444 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:24.766144 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:24.766619 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:24.767039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:24.767732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:24.768186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:24.768598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:24.902417 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:24.912571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-05af21f4-d451-496c-9596-568f3c1e7ba3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.158013 Aug 31 05:27:24.913077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 463/932] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:24 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:25.586184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:25.587201 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] [instance: 84115827-b1df-419c-b693-8b9105afcbbd] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:25.590261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:25.591310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:25.600496 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:25.600967 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:25.601380 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:25.602030 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:25.602492 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:25.602894 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:25.610503 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:25.611118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:25.614317 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:25.617089 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] HTTP exception thrown: Instance 84115827-b1df-419c-b693-8b9105afcbbd could not be found. Aug 31 05:27:25.618675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Request method failure captured: Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd HTTP/1.1 Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu92gSZpQyP5OuNDtC1bL3rIWef1lTc_-s_572_mpUcdTVuE-NjipgrUxNx47KqKnnQ-ezRHSq3fxNCBg5fDXa83PDymNLridLh6pSoW2J-5fCL6dXPLLIzzv0Pd7cK6ylH2W6og18ucGFq-rb4U8e2duh69pTyNqz-U6VX2LoblZ5k Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: ae98273d8d0040b39ed83c8b7aee74a6 Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestShelveInstance-1654782285 Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:27:25.618819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae98273d8d0040b39ed83c8b7aee74a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_ae98273d8d0040b39ed83c8b7aee74a6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/ae98273d8d0040b39ed83c8b7aee74a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/ae98273d8d0040b39ed83c8b7aee74a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestShelveInstance-1654782285 Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: ae98273d8d0040b39ed83c8b7aee74a6 Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestShelveInstance-1654782285 Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-TestShelveInstance-1654782285-project Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: a0063b9fa5dc4c3789db536f99a211fc Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestShelveInstance-1654782285-project Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 84115827-b1df-419c-b693-8b9105afcbbd could not be found. Aug 31 05:27:25.620273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '84115827-b1df-419c-b693-8b9105afcbbd'} Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84115827-b1df-419c-b693-8b9105afcbbd could not be found. Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:27:25.621179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84115827-b1df-419c-b693-8b9105afcbbd could not be found. Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84115827-b1df-419c-b693-8b9105afcbbd could not be found. Aug 31 05:27:25.623167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:27:25.625576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:25.625744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Returning 404 to user: Instance 84115827-b1df-419c-b693-8b9105afcbbd could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:27:25.625916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:25.626059 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0f886d2b-1f35-4cf9-bbb4-58bca56cbdd8 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd" status: 404 len: 111 microversion: 2.1 time: 0.040426 Aug 31 05:27:25.626168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:25.626264 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 470/933] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:25 2022] GET /compute/v2.1/servers/84115827-b1df-419c-b693-8b9105afcbbd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:27:25.626360 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:25.626360 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:25.767242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:25.775827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:25.778207 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:25.779738 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d34f643c-843f-4fd2-9dff-8fb6c35b9bd7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1743 microversion: 2.20 time: 0.173018 Aug 31 05:27:25.780501 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 464/934] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:25 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:25.807898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bab605ae-fd8d-43af-8568-58a53691d7f5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] Calling method '.version_select at 0x7fbd0eb3f700>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:25.829022 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bab605ae-fd8d-43af-8568-58a53691d7f5 tempest-TestShelveInstance-1654782285 tempest-TestShelveInstance-1654782285-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-928949727" status: 202 len: 0 microversion: 2.1 time: 0.025037 Aug 31 05:27:25.829773 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 471/935] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 05:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-928949727 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:27:25.876381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-556427a4-4d43-4771-b22f-4a870e86d007 req-6514b742-946d-421f-b826-783d76d479d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3", "name": "network-vif-plugged", "status": "completed", "tag": "8a7fc778-1730-48b9-b81b-87ca459e7396"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:25.887427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-556427a4-4d43-4771-b22f-4a870e86d007 req-6514b742-946d-421f-b826-783d76d479d2 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:25.887876 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-556427a4-4d43-4771-b22f-4a870e86d007 req-6514b742-946d-421f-b826-783d76d479d2 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:25.888510 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-556427a4-4d43-4771-b22f-4a870e86d007 req-6514b742-946d-421f-b826-783d76d479d2 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:25.900723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-556427a4-4d43-4771-b22f-4a870e86d007 req-6514b742-946d-421f-b826-783d76d479d2 service nova] Creating event network-vif-plugged:8a7fc778-1730-48b9-b81b-87ca459e7396 for instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 on hv-cinder-85220 Aug 31 05:27:25.906126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-556427a4-4d43-4771-b22f-4a870e86d007 req-6514b742-946d-421f-b826-783d76d479d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034210 Aug 31 05:27:25.906728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 465/936] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:25.932743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:25.933616 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:25.940854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:25.941642 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:25.942061 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:25.942971 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:25.943613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:25.944037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:25.964192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:26.231815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:26.240411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-82990c9e-5e7a-4bbc-a38c-fb9b82aeea37 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.311486 Aug 31 05:27:26.241049 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 472/937] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:25 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:26.805415 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:26.806115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:26.812276 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:26.812744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:26.813159 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:26.813884 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:26.814768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:26.815626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:26.817863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:27.056550 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:27.065844 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:27.067808 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:27.069454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9e290592-7eb5-47de-a363-b821d8e066c2 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1743 microversion: 2.20 time: 0.268863 Aug 31 05:27:27.070342 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 466/938] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:26 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1743 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:27:27.263870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:27.264513 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:27.271743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:27.272254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:27.272678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:27.273360 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:27.273804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:27.274253 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:27.459092 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:27.467256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-10e22b6d-d734-445b-872a-6706c213173e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.210102 Aug 31 05:27:27.467899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 473/939] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:27 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:28.093031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:28.093733 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:28.100747 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:28.101305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:28.101793 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:28.102696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:28.103195 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:28.103848 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:28.396090 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:28.410748 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:28.412467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:28.413759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-267b0136-e644-45b5-8470-38c7dae2278b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1743 microversion: 2.20 time: 0.324902 Aug 31 05:27:28.414430 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 467/940] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:28 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1743 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:28.487688 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:28.488293 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:28.494960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:28.495437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:28.495859 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:28.496537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:28.497012 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:28.497421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:28.666542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:28.690762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-429a30ef-e3b6-420d-ab2a-678d0c37b8a9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1365 microversion: 2.1 time: 0.206953 Aug 31 05:27:28.691452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 474/941] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:28 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:29.436923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:29.437629 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:29.444287 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:29.444754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:29.445173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:29.445812 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:29.446329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:29.446790 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:29.583016 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:29.591348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:29.592754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:29.594109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a226ca58-89a3-4e98-b16d-04c47e072bdc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1743 microversion: 2.20 time: 0.161175 Aug 31 05:27:29.594636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 468/942] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:29 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:29.714858 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:29.716625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:29.723769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:29.724254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:29.724925 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:29.725619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:29.726076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:29.726501 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:29.856883 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-fe4355fe-f5d8-47df-9057-14168df4a0c0 req-4ae451b2-269c-45fe-8714-82223aed6929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9517a7-1d14-4db3-ab98-835b298e1ab8", "name": "network-vif-plugged", "status": "completed", "tag": "fe7680cd-fd6f-4c92-b9ab-5050c6819de0"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:29.871720 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-fe4355fe-f5d8-47df-9057-14168df4a0c0 req-4ae451b2-269c-45fe-8714-82223aed6929 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:29.872505 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-fe4355fe-f5d8-47df-9057-14168df4a0c0 req-4ae451b2-269c-45fe-8714-82223aed6929 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:29.873149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-fe4355fe-f5d8-47df-9057-14168df4a0c0 req-4ae451b2-269c-45fe-8714-82223aed6929 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:29.877987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:29.886295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-fe4355fe-f5d8-47df-9057-14168df4a0c0 req-4ae451b2-269c-45fe-8714-82223aed6929 service nova] Creating event network-vif-plugged:fe7680cd-fd6f-4c92-b9ab-5050c6819de0 for instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 on hv-cinder-85220 Aug 31 05:27:29.888766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-076bb40a-935c-4da9-8117-14ccf8f0f68c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1555 microversion: 2.1 time: 0.177950 Aug 31 05:27:29.890577 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 475/943] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:27:29 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:27:29.898257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-fe4355fe-f5d8-47df-9057-14168df4a0c0 req-4ae451b2-269c-45fe-8714-82223aed6929 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046195 Aug 31 05:27:29.898257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 469/944] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:29.911858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:29.912831 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:29.919549 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:29.920095 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:29.920524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:29.921215 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:29.921679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:29.922128 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:30.248333 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a50eac67-aa87-4976-ade6-11de24f81b2a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.340895 Aug 31 05:27:30.248942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 470/945] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 05:27:29 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-interface => generated 284 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:30.617560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:30.618149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:30.628582 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:30.629078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:30.629806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:30.630731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:30.631401 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:30.631763 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:30.787084 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:30.796363 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:30.797802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:30.799036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c6f42332-a682-4997-b1c7-407314fcb339 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1743 microversion: 2.20 time: 0.185593 Aug 31 05:27:30.803365 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 476/946] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:30 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:31.822860 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:31.823447 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:31.834992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:31.837221 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:31.837662 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:31.838397 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:31.838840 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:31.839283 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:32.026691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-dd221113-9e2a-4cac-b69c-ad576850afc0 req-faffbe02-f62c-4464-b587-259c4726d8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3", "tag": "8a7fc778-1730-48b9-b81b-87ca459e7396"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:32.050092 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-dd221113-9e2a-4cac-b69c-ad576850afc0 req-faffbe02-f62c-4464-b587-259c4726d8d1 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:32.053804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-dd221113-9e2a-4cac-b69c-ad576850afc0 req-faffbe02-f62c-4464-b587-259c4726d8d1 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:32.054459 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-dd221113-9e2a-4cac-b69c-ad576850afc0 req-faffbe02-f62c-4464-b587-259c4726d8d1 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:32.078685 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-dd221113-9e2a-4cac-b69c-ad576850afc0 req-faffbe02-f62c-4464-b587-259c4726d8d1 service nova] Creating event network-changed:8a7fc778-1730-48b9-b81b-87ca459e7396 for instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 on hv-cinder-85220 Aug 31 05:27:32.092803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-dd221113-9e2a-4cac-b69c-ad576850afc0 req-faffbe02-f62c-4464-b587-259c4726d8d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070117 Aug 31 05:27:32.094119 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 477/947] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:27:32.122185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:32.142391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:32.145204 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:32.148184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-90aaddda-3cae-4b80-9b6c-4a6af661f8b7 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.329676 Aug 31 05:27:32.149009 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 471/948] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:31 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:33.181987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:33.191327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:33.206619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:33.207111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:33.207681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:33.208739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:33.209458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:33.210045 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:33.566173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:33.575196 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:33.580441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:33.583504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1e386322-9709-43b3-8241-4796ba9db4cc tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.409920 Aug 31 05:27:33.589800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 478/949] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:33 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:34.615256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:34.616637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:34.623873 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:34.624671 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:34.625217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:34.625987 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:34.626520 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:34.627030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:34.857130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:34.871238 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:34.873586 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:34.876255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-af8c7397-bfaf-4fe1-8a3b-34b1b6ad0245 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.264660 Aug 31 05:27:34.877193 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 472/950] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:34 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:35.900980 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:35.901550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:35.908636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:35.909267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:35.909705 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:35.910449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:35.911014 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:35.911799 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:36.054588 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:36.063776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:36.066315 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:36.067757 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b950d95d-2022-4e4d-877c-2a9d7556b5ce tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.170800 Aug 31 05:27:36.082056 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 479/951] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:35 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:37.091428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:37.093047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:37.100636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:37.101115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:37.101544 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:37.102341 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:37.103100 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:37.103710 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:37.243844 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:37.252464 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:37.253913 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:37.255321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4b0419e8-8acc-46d8-9254-f39c9ff2013f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.167824 Aug 31 05:27:37.255899 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 473/952] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:37 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:38.278921 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:38.279752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:38.290241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:38.290730 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:38.291141 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:38.291851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:38.292283 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:38.292694 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:38.436909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:38.445467 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:38.446941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:38.448096 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-08c22313-c4be-4269-a34b-2a9e05a3a034 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.173327 Aug 31 05:27:38.448937 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 480/953] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:38 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:39.474628 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:39.475281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:39.486032 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:39.487321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:39.488382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:39.489212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:39.490385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:39.491449 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:39.641661 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:39.652214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:39.654313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:39.655504 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bbaf1087-db6c-4af6-adf7-9d8c14ce70b6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.188212 Aug 31 05:27:39.656262 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 474/954] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:39 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:40.679776 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:40.680372 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:40.686823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:40.687291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:40.687706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:40.688372 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:40.688804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:40.689208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:40.832927 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:40.842204 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:40.843663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:40.844810 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c22ed562-e68e-458f-9712-96fd24be5861 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.168983 Aug 31 05:27:40.858198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 481/955] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:40 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:41.872332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:41.874376 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:41.885488 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:41.887126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:41.887887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:41.889126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:41.890064 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:41.890964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:42.034974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:42.043580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:42.045082 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:42.046273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-bad0eb03-705f-4d0f-bd49-d496e9389dc5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1738 microversion: 2.20 time: 0.180478 Aug 31 05:27:42.046838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 475/956] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:41 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:42.593712 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:42.594340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:42.601466 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:42.601950 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:42.602402 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:42.603110 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:42.603537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:42.603972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:42.630206 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7f810734-2f73-48dd-b8e5-fcc07b2205f9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/ips" status: 200 len: 145 microversion: 2.1 time: 0.040335 Aug 31 05:27:42.630819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 482/957] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:27:42 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:43.069563 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:43.069955 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:43.077277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:43.077683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:43.078134 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:43.078817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:43.079252 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:43.079656 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:43.222608 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:43.230958 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:43.232369 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:43.233521 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4d4fdc6a-f9b3-4d6b-a72b-ceb43fb208d6 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1720 microversion: 2.20 time: 0.168534 Aug 31 05:27:43.234115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 476/958] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:43 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:44.000612 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "253ad619-0928-4eaf-803f-ea8864b29385"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:44.003004 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:44.009464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:44.009936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:44.010391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:44.011058 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:44.011495 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:44.011907 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:44.257702 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:44.258301 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:44.265766 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:44.266278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:44.266704 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:44.267376 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:44.267813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:44.268217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:44.408962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:44.417795 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:44.419236 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:44.420382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2715a5ee-0d4a-412e-9ef7-185ccd3bd5c0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1720 microversion: 2.20 time: 0.167402 Aug 31 05:27:44.420940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 477/959] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:44 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:44.989617 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9cc475ac-8919-45af-9e58-b2be1355ae58 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992356 Aug 31 05:27:44.995521 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 483/960] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:27:43 2022] POST /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:27:45.443412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:45.443992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:45.446723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:45.452774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:45.453316 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:45.453792 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:45.454654 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:45.455114 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:45.455576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:45.588835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:45.597488 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:45.599015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:45.600184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c40aa8bc-3934-4862-b994-c510238047ea tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1723 microversion: 2.20 time: 0.161222 Aug 31 05:27:45.600718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 478/961] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:45 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:45.624749 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ed66e5f-6f51-4319-b803-8a1d84571346"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:45.627595 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:45.629752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:45.635276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:45.635962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:45.636386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:45.640898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:45.640898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:45.640898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:45.863008 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-5f9642dd-c62b-4ec2-95cf-73e456996fa7 req-7040e1fd-8e45-47df-891a-cbc989a09fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9517a7-1d14-4db3-ab98-835b298e1ab8", "name": "network-vif-unplugged", "status": "completed", "tag": "fe7680cd-fd6f-4c92-b9ab-5050c6819de0"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:45.873323 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5f9642dd-c62b-4ec2-95cf-73e456996fa7 req-7040e1fd-8e45-47df-891a-cbc989a09fd6 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:45.874052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5f9642dd-c62b-4ec2-95cf-73e456996fa7 req-7040e1fd-8e45-47df-891a-cbc989a09fd6 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:45.874571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5f9642dd-c62b-4ec2-95cf-73e456996fa7 req-7040e1fd-8e45-47df-891a-cbc989a09fd6 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:45.889190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.compute.server_external_events [req-5f9642dd-c62b-4ec2-95cf-73e456996fa7 req-7040e1fd-8e45-47df-891a-cbc989a09fd6 service nova] Unable to find a host for instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8. Dropping event network-vif-unplugged {{(pid=120607) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 05:27:45.890081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-5f9642dd-c62b-4ec2-95cf-73e456996fa7 req-7040e1fd-8e45-47df-891a-cbc989a09fd6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031479 Aug 31 05:27:45.890703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 479/962] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 05:27:45.934052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7545cbe3-09a5-4614-86f5-eadd3cf73685 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314377 Aug 31 05:27:45.934814 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 484/963] 10.222.0.36 () {62 vars in 1364 bytes} [Wed Aug 31 05:27:45 2022] POST /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 05:27:46.057955 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:46.058462 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:46.064954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:46.065511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:46.065928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:46.066654 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:46.067089 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:46.067491 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:46.327798 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-61acd8c3-dbd2-4aa9-97f3-32c0c35b71f1 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/os-volume_attachments/1ed66e5f-6f51-4319-b803-8a1d84571346" status: 202 len: 0 microversion: 2.20 time: 0.274031 Aug 31 05:27:46.328500 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 480/964] 10.222.0.36 () {60 vars in 1457 bytes} [Wed Aug 31 05:27:46 2022] DELETE /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/os-volume_attachments/1ed66e5f-6f51-4319-b803-8a1d84571346 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:27:46.393530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:27:46.394158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:46.401121 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:46.401121 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:46.401505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:46.402051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:46.402569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:46.402976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:46.434418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120608) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 05:27:46.472051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:46.503698 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a5c27a92-4c8e-45f3-a472-5cc8b8ab6422 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "POST /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/action" status: 202 len: 0 microversion: 2.20 time: 0.114028 Aug 31 05:27:46.507453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 485/965] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Aug 31 05:27:46 2022] POST /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:27:46.512543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:46.513109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:46.520401 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:46.521166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:46.521694 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:46.522494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:46.523168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:46.523697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:46.682524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:46.685999 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:46.691553 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:46.692969 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:46.694225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6fbb3425-fcf3-4a60-aff5-8da6e32d296e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1671 microversion: 2.20 time: 0.185609 Aug 31 05:27:46.694789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 481/966] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:46 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1671 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:47.722307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:47.723269 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:47.733570 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:47.734417 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:47.735123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:47.736242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:47.737035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:47.737724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:47.878321 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:47.886847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:47.888254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:47.889430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d6b95f02-dd85-4184-ae57-6efb4618da7a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.175050 Aug 31 05:27:47.889990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 486/967] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:47 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:48.914034 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:48.914571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:48.921749 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:48.922379 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:48.922802 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:48.923478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:48.923903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:48.924304 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:49.132850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:49.150393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:49.152117 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:49.153837 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-488bcda0-bfff-4522-a64b-aa9ae2e4b4ac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.244752 Aug 31 05:27:49.155166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 482/968] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:48 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:50.180819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:50.182538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:50.189873 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:50.190486 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:50.191173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:50.191979 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:50.192433 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:50.192836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:50.354039 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:50.363457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:50.364984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:50.366293 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-259ed1a0-cc1c-4666-bc12-9127c8e14708 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.191922 Aug 31 05:27:50.367304 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 487/969] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:50 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:51.390027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:51.390610 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:51.398143 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:51.399030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:51.399941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:51.401101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:51.402063 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:51.402683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:51.547014 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:51.556258 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:51.557825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:51.559086 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6c67cf23-45c6-4f1d-944e-c6d6f5140f7b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.173939 Aug 31 05:27:51.559731 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 483/970] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:51 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:52.582789 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:52.583447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:52.590251 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:52.590747 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:52.591180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:52.591920 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:52.592429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:52.592844 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:52.735219 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:52.743694 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:52.745148 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:52.746357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-97cf401b-252c-4b75-b00d-6f8b06241623 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.167557 Aug 31 05:27:52.747289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 488/971] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:52 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:53.769047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:53.769677 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:53.776664 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:53.777600 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:53.778413 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:53.780597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:53.781247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:53.781797 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:53.923768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:53.931966 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:53.933374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:53.934539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a98ba369-e5f6-47a9-b4fa-0e0e8d66a157 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.169517 Aug 31 05:27:53.935088 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 484/972] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:53 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:54.959208 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:54.959909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:54.967367 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:54.967828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:54.968493 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:54.969248 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:54.969925 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:54.970384 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:55.110247 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:55.118300 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:55.119733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:55.120862 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-10e72309-35b9-481f-96ad-46c055b93b32 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.166270 Aug 31 05:27:55.121411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 489/973] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:54 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:56.144395 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:56.145008 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:56.152005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:56.152457 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:56.152904 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:56.153588 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:56.154182 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:56.154596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:56.295616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:56.304980 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:56.306629 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:56.307857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4655ee06-9a7e-47af-9a2e-08096d85ed6e tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.167830 Aug 31 05:27:56.308541 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 485/974] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:56 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:57.331392 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:57.332004 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:57.339547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:57.340035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:57.340471 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:57.341174 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:57.341613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:57.342031 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:57.482462 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:57.490958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:57.492385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:57.493593 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-50152c12-9b09-4e0b-9125-fe5bf67dd3bf tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.166328 Aug 31 05:27:57.494177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 490/975] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:57 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:58.518560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:58.519283 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:58.527688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:58.528151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:58.528581 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:58.529296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:58.530033 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:58.530448 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:58.671429 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:58.680392 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:58.681880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:58.683141 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-68ce9db3-aa52-42e1-95e1-035ec5c66080 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.168854 Aug 31 05:27:58.683956 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 486/976] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:58 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:27:59.709112 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:27:59.709743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:27:59.720002 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:59.720678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:59.721504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:59.722516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:27:59.723150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:27:59.723741 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:27:59.866675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:59.875432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:59.876838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:27:59.878052 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1123c4c3-52d3-4591-817b-b30a1ff7dd72 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.174653 Aug 31 05:27:59.878593 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 491/977] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:27:59 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:00.907100 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:00.908049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:00.919446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:00.920261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:00.920974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:00.921682 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:00.922158 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:00.922576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:01.056785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:01.065366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:01.066957 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:01.068191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-13bbee72-8f66-4202-a0d7-647c1e99f98a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.168850 Aug 31 05:28:01.068753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 487/978] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:00 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:02.091352 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:02.091990 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:02.099252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:02.099809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:02.100233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:02.100968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:02.101440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:02.101870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:02.232529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:02.241402 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:02.242915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:02.244192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a7aaf21f-9e46-4ffb-a884-9c5087b83afe tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.157010 Aug 31 05:28:02.244759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 492/979] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:02 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:03.271540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:03.272475 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:03.283943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:03.284680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:03.285383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:03.286540 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:03.287314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:03.287989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:03.431877 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:03.440876 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:03.442316 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:03.443474 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-65f1aef9-4c18-4127-aff3-c330a3cfa39a tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.178840 Aug 31 05:28:03.444091 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 488/980] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:03 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:04.468752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:04.469377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:04.482244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:04.482244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:04.482244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:04.482244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:04.482808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:04.482808 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:04.626851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:04.639104 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:04.641244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:04.642727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9c69c130-07db-49cc-bf3c-c77f29b8cf9d tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.178370 Aug 31 05:28:04.643302 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 493/981] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:04 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:05.666439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:05.667163 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:05.675427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:05.675912 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:05.676331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:05.676983 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:05.678281 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:05.678723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:05.814151 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:05.823569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:05.825132 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:05.826348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-57a6c73f-a04e-4aea-afc1-2afc60df04a5 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.164844 Aug 31 05:28:05.826905 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 489/982] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:05 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:06.382844 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:06.385073 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:06.391907 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:06.392385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:06.392937 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:06.393619 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:06.394101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:06.394509 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:06.424677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4a4e9dd4-2498-46c2-8e6c-b5aa54b155a9 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Aug 31 05:28:06.425238 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 494/983] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:28:06 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:06.436173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:06.436652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:06.442886 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:06.443365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:06.443794 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:06.444497 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:06.444941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:06.445365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:06.474631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-01dc03dc-8b39-459d-9b4a-965e760cd9eb tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/253ad619-0928-4eaf-803f-ea8864b29385" status: 200 len: 194 microversion: 2.1 time: 0.042394 Aug 31 05:28:06.475225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 490/984] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Aug 31 05:28:06 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/253ad619-0928-4eaf-803f-ea8864b29385 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:06.850985 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:06.851590 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:06.858192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:06.858665 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:06.859086 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:06.859756 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:06.860193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:06.860604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:07.018353 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:07.027558 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:07.028970 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:07.030133 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b9d11691-49ca-4f80-985d-23852c3b561b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.183242 Aug 31 05:28:07.030691 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 495/985] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:06 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:07.821107 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16c6b11b-d695-48ac-8fda-62257b285833"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:28:07.823622 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:07.830242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:07.830723 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:07.831153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:07.831836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:07.832285 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:07.832705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:08.053988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:08.054881 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:08.061740 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:08.062265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:08.062668 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:08.063625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:08.064589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:08.065301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:08.135305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-44328708-ddda-4c92-8560-5c7a0f68e5d2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "POST /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318074 Aug 31 05:28:08.135930 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 491/986] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:28:07 2022] POST /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:08.173100 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-35fdb928-6465-4222-9ffd-58dda04cc2ee req-ef8bb644-6ffa-428a-9ff3-bacbc0c2bc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9517a7-1d14-4db3-ab98-835b298e1ab8", "name": "network-vif-plugged", "status": "completed", "tag": "fe7680cd-fd6f-4c92-b9ab-5050c6819de0"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:28:08.187950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-35fdb928-6465-4222-9ffd-58dda04cc2ee req-ef8bb644-6ffa-428a-9ff3-bacbc0c2bc75 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:08.188911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-35fdb928-6465-4222-9ffd-58dda04cc2ee req-ef8bb644-6ffa-428a-9ff3-bacbc0c2bc75 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:08.189492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-35fdb928-6465-4222-9ffd-58dda04cc2ee req-ef8bb644-6ffa-428a-9ff3-bacbc0c2bc75 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:08.204084 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-35fdb928-6465-4222-9ffd-58dda04cc2ee req-ef8bb644-6ffa-428a-9ff3-bacbc0c2bc75 service nova] Creating event network-vif-plugged:fe7680cd-fd6f-4c92-b9ab-5050c6819de0 for instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 on hv-cinder-85220 Aug 31 05:28:08.209988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-35fdb928-6465-4222-9ffd-58dda04cc2ee req-ef8bb644-6ffa-428a-9ff3-bacbc0c2bc75 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041682 Aug 31 05:28:08.210651 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 492/987] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:28:08.215651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:08.227138 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:08.228555 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:08.229755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d216e5fb-31a4-45a5-ba58-7160a225b574 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.180907 Aug 31 05:28:08.230368 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 496/988] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:08 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:09.252992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:09.253693 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:09.260425 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:09.260928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:09.261350 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:09.262041 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:09.262491 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:09.262899 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:09.403660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:09.412483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:09.413891 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:09.415106 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4aa5272f-842a-4f09-94b2-83162277911b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.166345 Aug 31 05:28:09.415659 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 493/989] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:09 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:10.436968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:10.437566 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:10.444387 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:10.444865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:10.445279 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:10.445979 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:10.446486 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:10.446837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:10.583298 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:10.591813 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:10.593488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:10.594883 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-31dd26f2-b478-4715-b601-fa14b9e8810b tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1729 microversion: 2.20 time: 0.161872 Aug 31 05:28:10.595452 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 497/990] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:10 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 05:28:11.618961 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:11.619470 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:11.626655 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:11.627128 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:11.627554 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:11.628243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:11.628684 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:11.629097 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:11.769868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:11.778757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:11.780454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:11.781648 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3de24156-5dba-414e-927b-3b9c53a13b6c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1716 microversion: 2.20 time: 0.166842 Aug 31 05:28:11.782256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 494/991] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:28:11 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:28:15.725997 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:15.728171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:15.730514 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:15.735715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:15.736194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:15.736607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:15.737288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:15.737732 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:15.738152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:15.767864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-51a13b3c-f1b9-4939-a50e-28254f5e9995 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045798 Aug 31 05:28:15.768396 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 498/992] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:28:15 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:15.921818 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:15.922557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:15.926247 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=34 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:15.933544 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:15.934029 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:15.934508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:15.935335 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:15.935827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:15.936237 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:15.967507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b400f1b0-26a2-4edd-b750-a46c24649e25 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/253ad619-0928-4eaf-803f-ea8864b29385" status: 200 len: 194 microversion: 2.1 time: 0.051943 Aug 31 05:28:15.968036 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 495/993] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Aug 31 05:28:15 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/253ad619-0928-4eaf-803f-ea8864b29385 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:15.984253 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:15.984829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:15.992908 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:15.993382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:15.993807 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:15.994517 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:15.994964 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:15.995378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:16.076845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lazy-loading 'services' on Instance uuid 92f9b586-a723-4308-ad75-4fadcfc03744 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:28:16.198371 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-56104f70-531d-44ef-82ab-c602c13efdc8 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/253ad619-0928-4eaf-803f-ea8864b29385" status: 202 len: 0 microversion: 2.1 time: 0.220278 Aug 31 05:28:16.198975 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 499/994] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:28:15 2022] DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/253ad619-0928-4eaf-803f-ea8864b29385 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:28:18.385760 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:18.386356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:18.393272 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:18.393776 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:18.394217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:18.394921 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:18.395366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:18.395770 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:18.425973 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f631b211-4b2f-49db-80b6-91cf660ddb62 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/16c6b11b-d695-48ac-8fda-62257b285833" status: 200 len: 194 microversion: 2.1 time: 0.044219 Aug 31 05:28:18.426591 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 496/995] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Aug 31 05:28:18 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/16c6b11b-d695-48ac-8fda-62257b285833 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:18.439244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:18.439800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:18.446710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:18.447178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:18.447606 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:18.448280 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:18.448722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:18.449128 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:18.451762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=90,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:18.534805 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lazy-loading 'services' on Instance uuid 92f9b586-a723-4308-ad75-4fadcfc03744 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:28:18.610510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b4272201-28e0-4d62-b66f-6a106f5a90b7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/16c6b11b-d695-48ac-8fda-62257b285833" status: 202 len: 0 microversion: 2.1 time: 0.176289 Aug 31 05:28:18.611179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 500/996] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:28:18 2022] DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments/16c6b11b-d695-48ac-8fda-62257b285833 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:28:19.787851 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:19.790226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:19.796996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:19.797467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:19.797920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:19.798618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:19.799060 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:19.799469 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:19.801795 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:19.832393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f4d5bb99-59d2-4405-8e11-21d586beafa6 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048676 Aug 31 05:28:19.832980 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 497/997] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:28:19 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:28:19.949038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:19.951380 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:19.957824 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:19.958325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:19.958748 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:19.959418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:19.959861 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:19.960268 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:19.989273 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e39bc3ca-7d79-4ae0-944d-d78e516622c3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045507 Aug 31 05:28:19.989821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 501/998] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:28:19 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:28:20.050932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:20.051421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:20.057517 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:20.057989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:20.058445 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:20.059124 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:20.059567 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:20.059983 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:20.084688 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Going to try to terminate instance {{(pid=120607) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:28:20.173056 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0423f739-dffb-4ee2-8d3a-2f0590d238ae tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 204 len: 0 microversion: 2.1 time: 0.125595 Aug 31 05:28:20.173674 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 498/999] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:28:20 2022] DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:28:20.182262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:20.182866 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:20.189002 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:20.189454 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:20.189880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:20.190594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:20.191047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:20.191465 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:20.319478 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:20.327703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-53d840a8-308d-4330-9fc8-182cf70a1315 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1674 microversion: 2.1 time: 0.149458 Aug 31 05:28:20.328316 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 502/1000] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:28:20 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:28:21.354862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:21.356025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:21.366890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:21.367683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:21.368434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:21.369507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:21.370295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:21.370979 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:21.515394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:21.527593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-aa4f1387-11bf-4cc9-ae8f-d92fe73853d0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1674 microversion: 2.1 time: 0.179557 Aug 31 05:28:21.528387 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 499/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:28:21 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:28:22.551424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:22.552003 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:22.559262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:22.559753 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:22.560182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:22.560873 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:22.561324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:22.561870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:22.815766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:22.824586 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8098ac5d-9a42-4368-ac73-9788299b5cf7 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1674 microversion: 2.1 time: 0.277018 Aug 31 05:28:22.838869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 503/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:28:22 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:28:23.293277 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-493166e1-2968-48dd-9576-5ed0a71b3813 req-9016658a-0ba3-493a-ba43-d5e72d1ff6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f9b586-a723-4308-ad75-4fadcfc03744", "name": "network-vif-deleted", "tag": "6cc5a2fe-947c-4c64-83fd-68b0acd1384c"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:28:23.303870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-493166e1-2968-48dd-9576-5ed0a71b3813 req-9016658a-0ba3-493a-ba43-d5e72d1ff6f1 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:23.304459 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-493166e1-2968-48dd-9576-5ed0a71b3813 req-9016658a-0ba3-493a-ba43-d5e72d1ff6f1 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:23.304991 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-493166e1-2968-48dd-9576-5ed0a71b3813 req-9016658a-0ba3-493a-ba43-d5e72d1ff6f1 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:23.317908 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-493166e1-2968-48dd-9576-5ed0a71b3813 req-9016658a-0ba3-493a-ba43-d5e72d1ff6f1 service nova] Creating event network-vif-deleted:6cc5a2fe-947c-4c64-83fd-68b0acd1384c for instance 92f9b586-a723-4308-ad75-4fadcfc03744 on hv-cinder-85220 Aug 31 05:28:23.328436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-493166e1-2968-48dd-9576-5ed0a71b3813 req-9016658a-0ba3-493a-ba43-d5e72d1ff6f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038779 Aug 31 05:28:23.329271 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 500/1003] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:23.847018 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:23.847642 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:23.854690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:23.855168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:23.855585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:23.856265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:23.856701 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:23.857115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:23.888628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:23.889077 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:23.889513 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:23.890063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lazy-loading 'fault' on Instance uuid 92f9b586-a723-4308-ad75-4fadcfc03744 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:28:23.936915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b07cff5bc3a4e68b62c4c5d3e798732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14058365e648441d96bb725c33f80923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:28:23.945591 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5a1118e4-efff-4046-a839-1f4e6cdc1dd0 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 200 len: 1328 microversion: 2.1 time: 0.102847 Aug 31 05:28:23.946373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 504/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:28:23 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:28:24.973202 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:24.974300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:24.985414 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:24.986260 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:24.986969 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:24.988079 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:24.988817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:24.989505 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:25.004010 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] HTTP exception thrown: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Request method failure captured: Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 HTTP/1.1 Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu80XnEtLwL5VXe40lnsTXrPaUxbDdK-7GucbvIhREHZBqiGEMSuvDqE1txS_g6vt_O4PpMjK2KIrMLGSV0uJFkWPwEdayS7WhRAAlWFjcbMhu3CwRQZ9msAvegRY9rpceBmPtCQKfwZG5z0Cz-aI_rsF8m2qOPdOKFAvmAYrJeM8w0 Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:28:25.005603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14058365e648441d96bb725c33f80923", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14058365e648441d96bb725c33f80923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 4b07cff5bc3a4e68b62c4c5d3e798732 Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:25.007206 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '92f9b586-a723-4308-ad75-4fadcfc03744'} Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:28:25.008292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:25.009809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:25.011294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Returning 404 to user: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:28:25.011294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e3ffbb88-4c78-452f-8a3c-f1daf8609ed2 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 404 len: 111 microversion: 2.1 time: 0.041450 Aug 31 05:28:25.011294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 501/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:28:24 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:28:25.016030 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7306cf2c-6922-49e8-8915-69e2ab21d3f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '.version_select at 0x7fbd0eb1baf0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:25.038183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7306cf2c-6922-49e8-8915-69e2ab21d3f3 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946565613" status: 202 len: 0 microversion: 2.1 time: 0.026005 Aug 31 05:28:25.038810 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 505/1006] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 05:28:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946565613 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:28:28.013924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:28.014530 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:28.021539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:28.022036 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:28.022483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:28.023189 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:28.023650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:28.024061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:28.037765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] HTTP exception thrown: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Request method failure captured: Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 HTTP/1.1 Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu80XnEtLwL5VXe40lnsTXrPaUxbDdK-7GucbvIhREHZBqiGEMSuvDqE1txS_g6vt_O4PpMjK2KIrMLGSV0uJFkWPwEdayS7WhRAAlWFjcbMhu3CwRQZ9msAvegRY9rpceBmPtCQKfwZG5z0Cz-aI_rsF8m2qOPdOKFAvmAYrJeM8w0 Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:28:28.039450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14058365e648441d96bb725c33f80923", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14058365e648441d96bb725c33f80923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 4b07cff5bc3a4e68b62c4c5d3e798732 Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.040965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '92f9b586-a723-4308-ad75-4fadcfc03744'} Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:28:28.041868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.043534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.044964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Returning 404 to user: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:28:28.044964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-620c0cfa-4b84-4c05-aa50-8520c542b87b tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 404 len: 111 microversion: 2.1 time: 0.030998 Aug 31 05:28:28.044964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 502/1007] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:28:28 2022] DELETE /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:28:28.053177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:28.053904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 92f9b586-a723-4308-ad75-4fadcfc03744] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:28.064658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:28.065293 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:28.065809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:28.066819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:28.067449 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:28.067978 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:28.082244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] HTTP exception thrown: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Request method failure captured: Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 HTTP/1.1 Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu80XnEtLwL5VXe40lnsTXrPaUxbDdK-7GucbvIhREHZBqiGEMSuvDqE1txS_g6vt_O4PpMjK2KIrMLGSV0uJFkWPwEdayS7WhRAAlWFjcbMhu3CwRQZ9msAvegRY9rpceBmPtCQKfwZG5z0Cz-aI_rsF8m2qOPdOKFAvmAYrJeM8w0 Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:28:28.083867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14058365e648441d96bb725c33f80923", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14058365e648441d96bb725c33f80923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 4b07cff5bc3a4e68b62c4c5d3e798732 Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.085579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '92f9b586-a723-4308-ad75-4fadcfc03744'} Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:28:28.086608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. Aug 31 05:28:28.087992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:28.089311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Returning 404 to user: Instance 92f9b586-a723-4308-ad75-4fadcfc03744 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:28:28.089311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-dc0739a7-9afb-41e6-af7e-d33015c3fbf4 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744" status: 404 len: 111 microversion: 2.1 time: 0.039471 Aug 31 05:28:28.089311 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 506/1008] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:28:28 2022] GET /compute/v2.1/servers/92f9b586-a723-4308-ad75-4fadcfc03744 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:28:29.239603 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:29.240168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:29.247631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:29.248111 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:29.248532 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:29.249227 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:29.249666 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:29.250108 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:29.263924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] HTTP exception thrown: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Request method failure captured: Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 HTTP/1.1 Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu80XnEtLwL5VXe40lnsTXrPaUxbDdK-7GucbvIhREHZBqiGEMSuvDqE1txS_g6vt_O4PpMjK2KIrMLGSV0uJFkWPwEdayS7WhRAAlWFjcbMhu3CwRQZ9msAvegRY9rpceBmPtCQKfwZG5z0Cz-aI_rsF8m2qOPdOKFAvmAYrJeM8w0 Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:28:29.265467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14058365e648441d96bb725c33f80923", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14058365e648441d96bb725c33f80923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 4b07cff5bc3a4e68b62c4c5d3e798732 Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.266952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '3104f831-5ba5-4ca1-a955-789bae89cb67'} Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:28:29.267742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.269025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.270322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Returning 404 to user: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:28:29.270322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3189e3d3-b51e-410a-84f6-90a93d577124 tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 404 len: 111 microversion: 2.1 time: 0.031916 Aug 31 05:28:29.270322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 503/1009] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:28:29 2022] DELETE /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:28:29.275648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:29.276250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] [instance: 3104f831-5ba5-4ca1-a955-789bae89cb67] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:29.283090 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:29.283558 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:29.283978 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:29.284646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:29.285170 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:29.285579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:29.300537 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] HTTP exception thrown: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Request method failure captured: Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 HTTP/1.1 Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu80XnEtLwL5VXe40lnsTXrPaUxbDdK-7GucbvIhREHZBqiGEMSuvDqE1txS_g6vt_O4PpMjK2KIrMLGSV0uJFkWPwEdayS7WhRAAlWFjcbMhu3CwRQZ9msAvegRY9rpceBmPtCQKfwZG5z0Cz-aI_rsF8m2qOPdOKFAvmAYrJeM8w0 Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:28:29.302050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_14058365e648441d96bb725c33f80923", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/14058365e648441d96bb725c33f80923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/14058365e648441d96bb725c33f80923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 14058365e648441d96bb725c33f80923 Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeTestJSON-535590377 Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 4b07cff5bc3a4e68b62c4c5d3e798732 Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeTestJSON-535590377-project Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.303715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '3104f831-5ba5-4ca1-a955-789bae89cb67'} Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:28:29.304649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. Aug 31 05:28:29.306278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:28:29.307727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] Returning 404 to user: Instance 3104f831-5ba5-4ca1-a955-789bae89cb67 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:28:29.307727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f4d7207e-04c8-4642-936e-b7328bcc714c tempest-AttachVolumeTestJSON-535590377 tempest-AttachVolumeTestJSON-535590377-project] 10.222.0.36 "GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67" status: 404 len: 111 microversion: 2.1 time: 0.031810 Aug 31 05:28:29.307727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 507/1010] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:28:29 2022] GET /compute/v2.1/servers/3104f831-5ba5-4ca1-a955-789bae89cb67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:28:47.509918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:28:47.510422 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:47.513132 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:47.513780 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:47.520073 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:47.520556 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:47.521006 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:47.521673 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:47.522215 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:47.522628 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:47.547632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-99e48a31-de36-4622-91ab-95265ac65c79 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/ips" status: 200 len: 150 microversion: 2.1 time: 0.041682 Aug 31 05:28:47.548201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 504/1011] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:28:47 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:50.022206 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "162f007e-4cf1-4c3a-9308-0640e77967e9"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:28:50.024488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:28:50.026660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:50.027307 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:50.033777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:50.034291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:50.034766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:50.035431 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:50.035863 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:50.036270 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:50.428907 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6c937b59-627d-4be5-8ee0-06c63901474d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411173 Aug 31 05:28:50.429547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 508/1012] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:28:50 2022] POST /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:28:58.009531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-340b1ec9-6f00-4358-9ef2-ba25db4ed925 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: .version_select at 0x7fbd0b37ddc0>, body: {"keypair": {"name": "tempest-keypair-1362263889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/eiQbg/racifMtFY4lmPlSN7/UAycdkiSdkfYLD+v13vhgD5Avgjmp3JFpqgEc9jK/PAP+cT3Sm4ckLJ8YH6Yl6gFmfG/ashUxqtjCEAwvp+ibRYt2Nfa/a+mCrtCXLw=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:28:58.015918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:58.016644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=4 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:58.028625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-340b1ec9-6f00-4358-9ef2-ba25db4ed925 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:28:58.033020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-340b1ec9-6f00-4358-9ef2-ba25db4ed925 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for user b0f728c7e4074084be1a433ae14879b8 and project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:28:58.056284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-340b1ec9-6f00-4358-9ef2-ba25db4ed925 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050640 Aug 31 05:28:58.056997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 505/1013] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:28:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:28:59.377772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-839186513", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "475a74f0-6918-4e96-839d-657934d65631"}], "security_groups": [{"name": "tempest-securitygroup--1167238140"}], "key_name": "tempest-keypair-1362263889", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:28:59.486638 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] validate_networks() for [('475a74f0-6918-4e96-839d-657934d65631', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:28:59.895472 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:28:59.895882 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:28:59.896343 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:28:59.896759 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:28:59.897152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:28:59.905781 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:59.906283 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:59.906745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:59.907477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:28:59.907914 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:28:59.908323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:28:59.925398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:28:59.929523 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for user b0f728c7e4074084be1a433ae14879b8 and project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:28:59.940386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:28:59.942826 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:28:59.989148 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c008909f-8500-4053-a567-da8c87187541 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616354 Aug 31 05:28:59.989966 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 509/1014] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:28:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:29:00.001619 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-544fe697-9d1f-4874-b231-d3c5a5f2a27b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:00.002346 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-544fe697-9d1f-4874-b231-d3c5a5f2a27b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:00.273606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-544fe697-9d1f-4874-b231-d3c5a5f2a27b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:00.280692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-544fe697-9d1f-4874-b231-d3c5a5f2a27b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1241 microversion: 2.1 time: 0.283898 Aug 31 05:29:00.281274 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 506/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:28:59 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1241 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:01.301865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:01.302592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:01.310860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:01.311636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:01.312115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:01.313054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:01.313682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:01.314334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:01.402922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:01.411530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d732d5f6-9136-4cc9-a6cc-4c89ea9bcbba tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1311 microversion: 2.1 time: 0.114686 Aug 31 05:29:01.418832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 510/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:01 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:02.432954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:02.433630 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:02.440544 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:02.441012 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:02.441431 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:02.442197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:02.442684 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:02.443091 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:02.658931 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:02.668718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6559f63f-3754-463f-97e6-ab45e75759e0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.239573 Aug 31 05:29:02.682137 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 507/1017] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:02 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:02.805803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-214d5ff4-8b68-4528-889e-39701393f028 req-1d2fa3c3-40c8-4358-a798-7d36b92b17fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6525e687-14ff-454b-8ccc-59b82ab1b8d5", "tag": "acbd09ed-052a-48ac-a1a0-03eaaf3006ae"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:29:02.816760 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-214d5ff4-8b68-4528-889e-39701393f028 req-1d2fa3c3-40c8-4358-a798-7d36b92b17fb service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:02.817313 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-214d5ff4-8b68-4528-889e-39701393f028 req-1d2fa3c3-40c8-4358-a798-7d36b92b17fb service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:02.817797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-214d5ff4-8b68-4528-889e-39701393f028 req-1d2fa3c3-40c8-4358-a798-7d36b92b17fb service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:02.830261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-214d5ff4-8b68-4528-889e-39701393f028 req-1d2fa3c3-40c8-4358-a798-7d36b92b17fb service nova] Creating event network-changed:acbd09ed-052a-48ac-a1a0-03eaaf3006ae for instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 on hv-cinder-85220 Aug 31 05:29:02.835137 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-214d5ff4-8b68-4528-889e-39701393f028 req-1d2fa3c3-40c8-4358-a798-7d36b92b17fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033959 Aug 31 05:29:02.835724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 511/1018] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:29:03.689985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:03.690577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:03.697478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:03.697956 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:03.698402 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:03.699052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:03.699492 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:03.699902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:03.850240 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:03.858059 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8c653a5a-88fe-47a2-b13e-b7eb82357c7e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.172266 Aug 31 05:29:03.858664 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 508/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:03 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:04.879553 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:04.880232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:04.887598 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:04.888053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:04.888473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:04.889174 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:04.889752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:04.890246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:05.034145 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:05.041926 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cea13e92-136f-4806-b056-7e1a7e2893b4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.166997 Aug 31 05:29:05.042518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 512/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:04 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:06.062693 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:06.063315 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:06.069692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:06.070221 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:06.070904 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:06.071670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:06.072109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:06.072511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:06.212381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:06.220915 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-867e6646-0bc2-4274-8063-2676d83198e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.162472 Aug 31 05:29:06.221509 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 509/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:06 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:07.243036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:07.243743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:07.250787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:07.251259 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:07.251659 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:07.252518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:07.252952 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:07.253388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:07.392500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:07.401131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1e29af6f-f161-48b0-b63f-8c26f4eeb2a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.162956 Aug 31 05:29:07.401892 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 513/1022] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:07 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:07.682152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:07.684414 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:07.690929 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:07.691456 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:07.691874 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:07.692585 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:07.692996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:07.693401 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:07.724231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7df8fbcb-c779-46b7-98fc-2a71f1798972 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046074 Aug 31 05:29:07.724811 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 510/1023] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Aug 31 05:29:07 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:07.788006 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:07.788505 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:07.794347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:07.795056 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:07.795481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:07.796155 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:07.796600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:07.797009 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:07.821953 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:29:07.907956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d9fbabc3-3189-4bb1-82a5-b62fa76b2568 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 204 len: 0 microversion: 2.20 time: 0.123723 Aug 31 05:29:07.910087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 514/1024] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Aug 31 05:29:07 2022] DELETE /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 05:29:07.919850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:07.920636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:07.927727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:07.928244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:07.928742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:07.929502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:07.929985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:07.930453 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:08.081101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:08.089962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:08.091551 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:08.092746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a1536ea8-60f9-4f17-bc4d-d0cba138b687 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.178316 Aug 31 05:29:08.093331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 511/1025] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:29:07 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:29:08.427381 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:08.427962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:08.434420 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:08.434885 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:08.435543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:08.436036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:08.436376 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:08.436775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:08.568910 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:08.576721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2b74fa99-775c-40ba-9562-ceffda21aa85 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.153635 Aug 31 05:29:08.577294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 515/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:08 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:09.118513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:09.119574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:09.127546 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:09.128181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:09.128886 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:09.129775 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:09.130236 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:09.130640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:09.323937 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:09.334080 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:09.335506 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:09.336655 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b9b4286d-751e-4fef-9bf5-7eea811b6491 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.224054 Aug 31 05:29:09.337210 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 512/1027] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:29:09 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:29:09.599722 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:09.600328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:09.607263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:09.607822 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:09.608463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:09.609382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:09.609830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:09.610268 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:09.760458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:09.768396 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cc1887ce-6d8f-4433-a735-4bc26c67907a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.173095 Aug 31 05:29:09.768976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 516/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:09 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:10.218299 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-c4a1b999-91c0-4fa0-8229-f329314b4c42 req-7e1e31ab-eefd-4918-9409-ade6cb768dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6525e687-14ff-454b-8ccc-59b82ab1b8d5", "name": "network-vif-plugged", "status": "completed", "tag": "acbd09ed-052a-48ac-a1a0-03eaaf3006ae"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:29:10.229538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c4a1b999-91c0-4fa0-8229-f329314b4c42 req-7e1e31ab-eefd-4918-9409-ade6cb768dce service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:10.230331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c4a1b999-91c0-4fa0-8229-f329314b4c42 req-7e1e31ab-eefd-4918-9409-ade6cb768dce service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:10.230911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c4a1b999-91c0-4fa0-8229-f329314b4c42 req-7e1e31ab-eefd-4918-9409-ade6cb768dce service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:10.243070 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-c4a1b999-91c0-4fa0-8229-f329314b4c42 req-7e1e31ab-eefd-4918-9409-ade6cb768dce service nova] Creating event network-vif-plugged:acbd09ed-052a-48ac-a1a0-03eaaf3006ae for instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 on hv-cinder-85220 Aug 31 05:29:10.248252 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-c4a1b999-91c0-4fa0-8229-f329314b4c42 req-7e1e31ab-eefd-4918-9409-ade6cb768dce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033990 Aug 31 05:29:10.248930 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 513/1029] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:29:10.361149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:10.362069 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:10.364408 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:10.365156 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:10.372954 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:10.373542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:10.374226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:10.375244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:10.375807 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:10.376281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:10.786443 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:10.791039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:10.791836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:10.798753 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:10.799234 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:10.799655 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:10.800348 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:10.800830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:10.801235 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:10.903670 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:10.912227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:10.913667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:10.914879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-350735e5-e4f4-40d5-bb84-f1d1bdb514b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1722 microversion: 2.20 time: 0.558281 Aug 31 05:29:10.915738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 517/1030] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:29:10 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1722 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:29:11.065298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:11.075287 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6279aa4c-b446-4f21-a55a-dec7415edad2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.288930 Aug 31 05:29:11.076178 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 514/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:10 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:11.141059 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-111767504", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "networks": [{"uuid": "8c16c63a-ca61-4dcf-8ba9-b847ea686a8d"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:29:11.195271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] validate_networks() for [('8c16c63a-ca61-4dcf-8ba9-b847ea686a8d', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:29:11.372141 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-5b900d36-a41b-4755-8fff-f248171508c7 req-2b376ede-5bb1-48ec-a2f4-7037c7f89f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9517a7-1d14-4db3-ab98-835b298e1ab8", "name": "network-vif-deleted", "tag": "fe7680cd-fd6f-4c92-b9ab-5050c6819de0"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:29:11.393362 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5b900d36-a41b-4755-8fff-f248171508c7 req-2b376ede-5bb1-48ec-a2f4-7037c7f89f4b service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:11.394109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5b900d36-a41b-4755-8fff-f248171508c7 req-2b376ede-5bb1-48ec-a2f4-7037c7f89f4b service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:11.394818 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-5b900d36-a41b-4755-8fff-f248171508c7 req-2b376ede-5bb1-48ec-a2f4-7037c7f89f4b service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:11.423919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-5b900d36-a41b-4755-8fff-f248171508c7 req-2b376ede-5bb1-48ec-a2f4-7037c7f89f4b service nova] Creating event network-vif-deleted:fe7680cd-fd6f-4c92-b9ab-5050c6819de0 for instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 on hv-cinder-85220 Aug 31 05:29:11.433759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-5b900d36-a41b-4755-8fff-f248171508c7 req-2b376ede-5bb1-48ec-a2f4-7037c7f89f4b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065400 Aug 31 05:29:11.435004 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 515/1032] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:29:11.637815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:29:11.638465 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:29:11.639041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:29:11.639564 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:29:11.640064 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:29:11.650189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:11.650673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:11.651099 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:11.651819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:11.652262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:11.652658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:11.669974 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Getting quotas for project 25348a2fd6ba43bbb3cf5e8126cd8a67. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:29:11.673928 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Getting quotas for user 695bbf71deee465985055e79dc8e105e and project 25348a2fd6ba43bbb3cf5e8126cd8a67. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:29:11.684836 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:29:11.687161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:29:11.737428 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-edad6e62-29d9-4463-a3a8-2c38e4a7639a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600122 Aug 31 05:29:11.738640 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 518/1033] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:29:11.750304 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3b7bd33c-e6f9-4e57-885a-107a41653a20 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:11.751248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-3b7bd33c-e6f9-4e57-885a-107a41653a20 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:11.809883 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-3b7bd33c-e6f9-4e57-885a-107a41653a20 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:11.817897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3b7bd33c-e6f9-4e57-885a-107a41653a20 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1218 microversion: 2.1 time: 0.071932 Aug 31 05:29:11.818531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 516/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:11 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:11.938202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:11.939683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:11.948755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:11.949239 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:11.950128 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:11.951248 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:11.951784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:11.952261 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:11.994879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:11.995357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:11.995779 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:11.996213 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lazy-loading 'fault' on Instance uuid 1d9517a7-1d14-4db3-ab98-835b298e1ab8 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:29:12.044246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:12.056667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:12.058274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af50ca6347404cdf8eb213d27053af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c57b95c274f89bd391cf111efa374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:12.059603 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1e9ebbc2-578f-4926-95fa-3d3c54f224b9 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 200 len: 1371 microversion: 2.20 time: 0.125387 Aug 31 05:29:12.060721 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 519/1035] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:29:11 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 05:29:12.098031 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:12.098788 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:12.106077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:12.106643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:12.107226 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:12.108160 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:12.108685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:12.109471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:12.273065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:12.281467 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-25984aea-62cd-46e3-ba91-b40837ae598c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.188791 Aug 31 05:29:12.282065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 517/1036] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:12 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:12.843218 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:12.844557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:12.852562 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:12.853037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:12.853457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:12.854202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:12.854643 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:12.855051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:12.917250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:12.925272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-69024abe-59eb-410f-9613-5c5d5350460e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1222 microversion: 2.1 time: 0.088541 Aug 31 05:29:12.925815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 520/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:12 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:13.084396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:13.085233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:13.091709 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:13.092732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:13.092732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:13.094030 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:13.094539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:13.094991 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:13.109485 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] HTTP exception thrown: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Request method failure captured: Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 HTTP/1.1 Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu84xo3gecsnKPoBabsYGq6KYPt3W-SSu8Y6_k7eNJeGmchEsdfNHYL0dLj4QK5SU6AxHYUoCdZmgGxrWt-qAKQgYCs_cYQNoOZ4Ix8nK-Ox78xxbCpqZkZcBRr9D_RPwvQGiOcQewodxnrEUBI-pfpUgqCuQwR_Dzo8A3xgMWGiF5w Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:29:13.111269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_164c57b95c274f89bd391cf111efa374", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/164c57b95c274f89bd391cf111efa374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: af50ca6347404cdf8eb213d27053af16 Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:13.112924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '1d9517a7-1d14-4db3-ab98-835b298e1ab8'} Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:29:13.113863 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:13.115643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:13.117592 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Returning 404 to user: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:29:13.118476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d19e38f1-dabd-4a7b-9cec-b2eb20b452e0 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 404 len: 111 microversion: 2.20 time: 0.039530 Aug 31 05:29:13.119355 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 518/1038] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:29:13 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:29:13.128933 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-12e695df-6161-41ab-a13f-5e642bb63c50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '.version_select at 0x7fbd0eaf90d0>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:13.148579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-12e695df-6161-41ab-a13f-5e642bb63c50 tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-354118219" status: 204 len: 0 microversion: 2.20 time: 0.023830 Aug 31 05:29:13.149460 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 521/1039] 10.222.0.36 () {60 vars in 1259 bytes} [Wed Aug 31 05:29:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-354118219 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 05:29:13.301962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:13.302824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:13.309391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:13.310213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:13.310842 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:13.311546 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:13.311993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:13.312406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:13.445890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:13.455273 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d621b61e-a34b-4dd8-9ad8-7d05d74300a1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1557 microversion: 2.1 time: 0.157444 Aug 31 05:29:13.455875 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 519/1040] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:13 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:13.475887 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:13.476377 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:13.482842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:13.483329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:13.483733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:13.484418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:13.484870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:13.485295 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:13.569767 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-07a808e2-c25c-4a68-9ea2-0f106eaf23b3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097825 Aug 31 05:29:13.570684 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 522/1041] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 05:29:13 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:29:13.946506 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:13.947173 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:13.953385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:13.953864 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:13.954285 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:13.955212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:13.955642 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:13.956057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:14.068274 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:14.076631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e0135af3-1df6-462a-bbac-ac47d92c1715 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1276 microversion: 2.1 time: 0.134097 Aug 31 05:29:14.077326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 520/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:13 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:14.964603 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:14.965097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:14.971546 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:14.972013 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:14.972540 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:14.973200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:14.973605 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:14.974246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:14.987963 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] HTTP exception thrown: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Request method failure captured: Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: DELETE /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 HTTP/1.1 Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu84xo3gecsnKPoBabsYGq6KYPt3W-SSu8Y6_k7eNJeGmchEsdfNHYL0dLj4QK5SU6AxHYUoCdZmgGxrWt-qAKQgYCs_cYQNoOZ4Ix8nK-Ox78xxbCpqZkZcBRr9D_RPwvQGiOcQewodxnrEUBI-pfpUgqCuQwR_Dzo8A3xgMWGiF5w Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:29:14.989673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_164c57b95c274f89bd391cf111efa374", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/164c57b95c274f89bd391cf111efa374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: af50ca6347404cdf8eb213d27053af16 Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:14.991358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '1d9517a7-1d14-4db3-ab98-835b298e1ab8'} Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:29:14.992200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:14.993504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:14.994764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Returning 404 to user: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:29:14.994764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d713d0df-e653-4901-a09e-7b84911acf1f tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 404 len: 111 microversion: 2.20 time: 0.031466 Aug 31 05:29:14.994764 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 523/1043] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Aug 31 05:29:14 2022] DELETE /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:29:15.000147 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:15.000858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 1d9517a7-1d14-4db3-ab98-835b298e1ab8] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:15.007607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:15.008155 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:15.008651 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:15.009439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:15.010083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:15.010468 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:15.024179 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] HTTP exception thrown: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Request method failure captured: Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 HTTP/1.1 Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu84xo3gecsnKPoBabsYGq6KYPt3W-SSu8Y6_k7eNJeGmchEsdfNHYL0dLj4QK5SU6AxHYUoCdZmgGxrWt-qAKQgYCs_cYQNoOZ4Ix8nK-Ox78xxbCpqZkZcBRr9D_RPwvQGiOcQewodxnrEUBI-pfpUgqCuQwR_Dzo8A3xgMWGiF5w Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:29:15.025757 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_164c57b95c274f89bd391cf111efa374", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/164c57b95c274f89bd391cf111efa374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: af50ca6347404cdf8eb213d27053af16 Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:15.027266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '1d9517a7-1d14-4db3-ab98-835b298e1ab8'} Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:29:15.031149 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. Aug 31 05:29:15.032502 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:15.034589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Returning 404 to user: Instance 1d9517a7-1d14-4db3-ab98-835b298e1ab8 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:29:15.034589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-aa09d9a2-d3fd-4afd-8d24-b0c6a1c6d4ca tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8" status: 404 len: 111 microversion: 2.20 time: 0.031028 Aug 31 05:29:15.034589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 521/1044] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:29:14 2022] GET /compute/v2.1/servers/1d9517a7-1d14-4db3-ab98-835b298e1ab8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:29:15.100298 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:15.101434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:15.109338 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:15.110178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:15.110778 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:15.111596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-59297cf6-7218-4117-a34c-943569aaab80 req-68f3e54b-b16c-43d1-a773-10669eb86c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6525e687-14ff-454b-8ccc-59b82ab1b8d5", "tag": "acbd09ed-052a-48ac-a1a0-03eaaf3006ae"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:29:15.112085 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:15.112710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:15.113491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:15.129733 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-59297cf6-7218-4117-a34c-943569aaab80 req-68f3e54b-b16c-43d1-a773-10669eb86c5e service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:15.130347 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-59297cf6-7218-4117-a34c-943569aaab80 req-68f3e54b-b16c-43d1-a773-10669eb86c5e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:15.132441 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-59297cf6-7218-4117-a34c-943569aaab80 req-68f3e54b-b16c-43d1-a773-10669eb86c5e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:15.147298 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-59297cf6-7218-4117-a34c-943569aaab80 req-68f3e54b-b16c-43d1-a773-10669eb86c5e service nova] Creating event network-changed:acbd09ed-052a-48ac-a1a0-03eaaf3006ae for instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 on hv-cinder-85220 Aug 31 05:29:15.154116 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-59297cf6-7218-4117-a34c-943569aaab80 req-68f3e54b-b16c-43d1-a773-10669eb86c5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047784 Aug 31 05:29:15.155067 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 522/1045] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:29:15.667390 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:15.675467 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6771ee8c-d8d9-45de-a2fa-35b3b01fc625 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.580825 Aug 31 05:29:15.676206 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 524/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:15 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:16.224478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:16.225021 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:16.232271 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:16.232770 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:16.233187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:16.233866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:16.234370 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:16.234768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:16.248679 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] HTTP exception thrown: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Request method failure captured: Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 HTTP/1.1 Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDu84xo3gecsnKPoBabsYGq6KYPt3W-SSu8Y6_k7eNJeGmchEsdfNHYL0dLj4QK5SU6AxHYUoCdZmgGxrWt-qAKQgYCs_cYQNoOZ4Ix8nK-Ox78xxbCpqZkZcBRr9D_RPwvQGiOcQewodxnrEUBI-pfpUgqCuQwR_Dzo8A3xgMWGiF5w Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:29:16.250365 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_164c57b95c274f89bd391cf111efa374", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/164c57b95c274f89bd391cf111efa374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: af50ca6347404cdf8eb213d27053af16 Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.252015 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '5b209be4-6027-4328-a956-5deea7de1a64'} Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:29:16.252869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.254391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.255944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Returning 404 to user: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:29:16.255944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-88740546-b55c-4196-8afb-0337ea72caac tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 404 len: 111 microversion: 2.20 time: 0.031704 Aug 31 05:29:16.255944 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 523/1047] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Aug 31 05:29:16 2022] DELETE /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:29:16.261010 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:16.261692 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] [instance: 5b209be4-6027-4328-a956-5deea7de1a64] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:16.268644 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:16.269263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:16.269718 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:16.270506 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:16.271014 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:16.271491 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:16.275627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:16.285809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] HTTP exception thrown: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Request method failure captured: Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 HTTP/1.1 Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDu84xo3gecsnKPoBabsYGq6KYPt3W-SSu8Y6_k7eNJeGmchEsdfNHYL0dLj4QK5SU6AxHYUoCdZmgGxrWt-qAKQgYCs_cYQNoOZ4Ix8nK-Ox78xxbCpqZkZcBRr9D_RPwvQGiOcQewodxnrEUBI-pfpUgqCuQwR_Dzo8A3xgMWGiF5w Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:29:16.287470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_164c57b95c274f89bd391cf111efa374", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/164c57b95c274f89bd391cf111efa374"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/164c57b95c274f89bd391cf111efa374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 164c57b95c274f89bd391cf111efa374 Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1973466496 Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: af50ca6347404cdf8eb213d27053af16 Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1973466496-project Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.290257 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '5b209be4-6027-4328-a956-5deea7de1a64'} Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:29:16.291755 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. Aug 31 05:29:16.293504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:29:16.294875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] Returning 404 to user: Instance 5b209be4-6027-4328-a956-5deea7de1a64 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:29:16.294875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4858b742-0f03-49a3-bed5-ff5bb8569b1c tempest-AttachVolumeShelveTestJSON-1973466496 tempest-AttachVolumeShelveTestJSON-1973466496-project] 10.222.0.36 "GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64" status: 404 len: 111 microversion: 2.20 time: 0.031804 Aug 31 05:29:16.294875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 525/1048] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 05:29:16 2022] GET /compute/v2.1/servers/5b209be4-6027-4328-a956-5deea7de1a64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:29:16.697335 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:16.697933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:16.706242 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:16.706725 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:16.707145 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:16.707830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:16.708276 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:16.708895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:16.929450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:16.937350 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-d3cb69da-928b-4442-ba04-ffa2ab68c8ba tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.244050 Aug 31 05:29:16.937923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 524/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:16 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:17.175131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-57c081a4-256b-42e5-a8e1-c048aa347f3a req-ee1c1f06-cd00-4e79-af65-3eb6a5df8231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7beb9d47-b838-41d6-b4ca-44c24a2ccad9", "tag": "be1b17d3-2c6a-409a-99c2-1f3ce1fe1c44"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:29:17.185382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-57c081a4-256b-42e5-a8e1-c048aa347f3a req-ee1c1f06-cd00-4e79-af65-3eb6a5df8231 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:17.185758 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-57c081a4-256b-42e5-a8e1-c048aa347f3a req-ee1c1f06-cd00-4e79-af65-3eb6a5df8231 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:17.186210 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-57c081a4-256b-42e5-a8e1-c048aa347f3a req-ee1c1f06-cd00-4e79-af65-3eb6a5df8231 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:17.197951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-57c081a4-256b-42e5-a8e1-c048aa347f3a req-ee1c1f06-cd00-4e79-af65-3eb6a5df8231 service nova] Creating event network-changed:be1b17d3-2c6a-409a-99c2-1f3ce1fe1c44 for instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 on hv-cinder-85220 Aug 31 05:29:17.203948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-57c081a4-256b-42e5-a8e1-c048aa347f3a req-ee1c1f06-cd00-4e79-af65-3eb6a5df8231 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033353 Aug 31 05:29:17.204549 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 526/1050] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:29:17.958065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:17.958670 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:17.965043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:17.965714 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:17.966160 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:17.966829 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:17.967429 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:17.967834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:18.170470 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:18.178718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-80dbe342-cb1c-484e-8698-52f9323ffb04 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.224525 Aug 31 05:29:18.179355 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 525/1051] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:17 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:19.201909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:19.204140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:19.214332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:19.215210 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:19.219447 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:19.220696 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:19.221035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:19.221557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:19.586508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:19.597677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9733d7ad-d19a-4392-b302-691b3f6f1898 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.401229 Aug 31 05:29:19.598657 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 527/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:19 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:20.618541 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:20.619171 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:20.625718 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:20.626231 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:20.626659 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:20.627332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:20.627775 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:20.628222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:20.774432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:20.782476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-17f95efa-57e6-4787-884f-7f33927b3ae9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.167882 Aug 31 05:29:20.783307 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 526/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:20 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:21.804591 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:21.805126 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:21.811250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:21.811250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:21.811250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:21.816095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:21.816583 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:21.817011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:21.817663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:21.818134 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:21.818575 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:21.953984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:21.961609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a910aa5d-c3d6-4d10-b6d7-42f3eab29498 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.161556 Aug 31 05:29:21.962183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 528/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:21 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:22.987992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:22.988658 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:22.991595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:22.998152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:22.998719 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:22.999227 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:23.000017 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:23.000536 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:23.001027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:23.144016 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:23.151823 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a927e204-a44e-408d-896c-ed9f3fe7df11 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.170854 Aug 31 05:29:23.152388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 527/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:22 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:24.172600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:24.173220 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:24.180398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:24.180877 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:24.181588 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:24.182301 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:24.182739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:24.183326 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:24.271081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-35aec47b-2449-42aa-9276-de7135bc2c4c req-17bf6cf4-f02f-4aa9-b5fb-13af4bbb916f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7beb9d47-b838-41d6-b4ca-44c24a2ccad9", "name": "network-vif-plugged", "status": "completed", "tag": "be1b17d3-2c6a-409a-99c2-1f3ce1fe1c44"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:29:24.281907 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-35aec47b-2449-42aa-9276-de7135bc2c4c req-17bf6cf4-f02f-4aa9-b5fb-13af4bbb916f service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:24.282496 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-35aec47b-2449-42aa-9276-de7135bc2c4c req-17bf6cf4-f02f-4aa9-b5fb-13af4bbb916f service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:24.283084 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-35aec47b-2449-42aa-9276-de7135bc2c4c req-17bf6cf4-f02f-4aa9-b5fb-13af4bbb916f service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:24.294981 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-35aec47b-2449-42aa-9276-de7135bc2c4c req-17bf6cf4-f02f-4aa9-b5fb-13af4bbb916f service nova] Creating event network-vif-plugged:be1b17d3-2c6a-409a-99c2-1f3ce1fe1c44 for instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 on hv-cinder-85220 Aug 31 05:29:24.301027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-35aec47b-2449-42aa-9276-de7135bc2c4c req-17bf6cf4-f02f-4aa9-b5fb-13af4bbb916f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033683 Aug 31 05:29:24.301739 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 528/1056] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:29:24.321418 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:24.329732 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-315faefb-26a9-4d26-bd45-409b022ccfc0 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.160974 Aug 31 05:29:24.330348 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 529/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:24 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:25.356970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:25.357931 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:25.366503 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:25.366970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:25.367391 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:25.368069 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:25.368507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:25.368930 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:25.373013 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=100 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:25.515306 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:25.527872 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-93982ff6-1641-43bc-8d93-f584add5a8e6 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.178637 Aug 31 05:29:25.528794 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 529/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:25 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:26.553025 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:26.553629 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:26.560709 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:26.561240 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:26.561651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:26.562354 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:26.562793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:26.563203 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:26.721329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:26.731656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1b8866d2-b825-4d38-b39a-5ef05d03c13a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.182658 Aug 31 05:29:26.732234 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 530/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:26 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:27.757350 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:27.757951 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:27.765006 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:27.765481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:27.765903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:27.766625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:27.767065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:27.767575 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:27.906248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:27.914576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-150bdfa2-dec9-49b1-ba25-be9f1a14a467 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.162771 Aug 31 05:29:27.915139 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 530/1060] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:27 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:28.939923 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:28.940782 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:28.951719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:28.952524 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:28.953238 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:28.954389 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:28.955131 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:28.955818 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:29.098189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:29.106677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8fc9582e-4f66-4e95-9074-a70b12343da1 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1318 microversion: 2.1 time: 0.173472 Aug 31 05:29:29.107320 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 531/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:28 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:30.132198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:29:30.132829 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:30.135447 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:30.140953 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:30.141420 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:30.141838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:30.142559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:30.142996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:30.143404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:30.291748 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:29:30.302211 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-544cbb4d-8bab-4415-a199-a8ecb6609e4a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1508 microversion: 2.1 time: 0.175274 Aug 31 05:29:30.302824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 531/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:29:30 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:29:53.992686 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae798f03-ac24-49f1-9d1f-880555bd773f", "device": "/dev/sdb"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:29:53.999848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:29:53.999848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=7 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:53.999848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=32 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:54.004580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:54.005054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:54.005473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:54.006180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:29:54.006620 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:29:54.007026 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:29:54.299521 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-40a9b1eb-bea2-4650-96aa-612805739a3a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "POST /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310886 Aug 31 05:29:54.300107 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 532/1063] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:29:53 2022] POST /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:30:21.310179 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:21.310727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:21.312954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:21.313598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=16 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:21.319864 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:21.320344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:21.320775 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:21.321440 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:21.321880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:21.322317 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:21.413137 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lazy-loading 'services' on Instance uuid 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:30:21.497383 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-345d5f65-8051-4433-8282-bb24d6cc5b1f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9/os-volume_attachments/ae798f03-ac24-49f1-9d1f-880555bd773f" status: 202 len: 0 microversion: 2.1 time: 0.191108 Aug 31 05:30:21.497972 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 532/1064] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:30:21 2022] DELETE /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9/os-volume_attachments/ae798f03-ac24-49f1-9d1f-880555bd773f => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:30:22.622932 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:22.623735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:22.629569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:22.630184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:22.638173 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:22.638657 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:22.639087 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:22.639775 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:22.640225 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:22.640649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:22.667200 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:30:22.750579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ffaea991-d700-40a4-b3ca-d0538997ccfd tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 204 len: 0 microversion: 2.1 time: 0.128857 Aug 31 05:30:22.751250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 533/1065] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:30:22 2022] DELETE /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:30:22.760983 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:22.761689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:22.768153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:22.768620 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:22.769035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:22.769701 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:22.770194 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:22.770604 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:22.901426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:22.913037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4df6cd2a-22d2-4e05-8ce3-98744da3538c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1514 microversion: 2.1 time: 0.156599 Aug 31 05:30:22.913868 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 533/1066] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:22 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:30:23.939056 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:23.939869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:23.948250 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:23.948726 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:23.949145 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:23.949830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:23.950302 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:23.950707 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:24.092745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:24.100934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-aae9c978-86f5-4dee-b837-3acbd66beb19 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1514 microversion: 2.1 time: 0.168955 Aug 31 05:30:24.101516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 534/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:23 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:25.122223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:25.122813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:25.129504 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:25.129976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:25.130433 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:25.131109 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:25.131546 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:25.131954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:25.342954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:25.351845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6ab99dc3-6a91-4492-9726-ebef6451d127 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 200 len: 1514 microversion: 2.1 time: 0.233660 Aug 31 05:30:25.352686 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 534/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:25 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:25.708385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-2a1d3023-c9fb-495b-b6a3-d56c4cbccdcf req-63b56015-3bbe-4351-a25d-2982888f513b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7beb9d47-b838-41d6-b4ca-44c24a2ccad9", "name": "network-vif-deleted", "tag": "be1b17d3-2c6a-409a-99c2-1f3ce1fe1c44"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:30:25.718752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2a1d3023-c9fb-495b-b6a3-d56c4cbccdcf req-63b56015-3bbe-4351-a25d-2982888f513b service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:25.719221 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2a1d3023-c9fb-495b-b6a3-d56c4cbccdcf req-63b56015-3bbe-4351-a25d-2982888f513b service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:25.719671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2a1d3023-c9fb-495b-b6a3-d56c4cbccdcf req-63b56015-3bbe-4351-a25d-2982888f513b service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:25.730765 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-2a1d3023-c9fb-495b-b6a3-d56c4cbccdcf req-63b56015-3bbe-4351-a25d-2982888f513b service nova] Creating event network-vif-deleted:be1b17d3-2c6a-409a-99c2-1f3ce1fe1c44 for instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 on hv-cinder-85220 Aug 31 05:30:25.735740 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-2a1d3023-c9fb-495b-b6a3-d56c4cbccdcf req-63b56015-3bbe-4351-a25d-2982888f513b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221330 Aug 31 05:30:25.736324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 535/1069] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:30:26.377116 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:26.377945 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 7beb9d47-b838-41d6-b4ca-44c24a2ccad9] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:26.388785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:26.389564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:26.390336 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:26.391560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:26.392007 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:26.392385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:26.405922 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] HTTP exception thrown: Instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 could not be found. Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Request method failure captured: Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 HTTP/1.1 Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvGl3hTEKZbnNCvvnrmrU9I4Lvrn9hSBP_byw5nSQtkygM628Y6tbwERGBzyYgNF9hnYDTpX6-do1jXmC2aQOllVh_QdhJZa3Voss0mGsMACFkOvURYM6NTyQYTY1lOKOrFxKjQC5Xx_z80WCo97KWhJh_-fcUeyiKyBJtPY0bSe4pk Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 25348a2fd6ba43bbb3cf5e8126cd8a67 Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2048147728 Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:30:26.407569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25348a2fd6ba43bbb3cf5e8126cd8a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25348a2fd6ba43bbb3cf5e8126cd8a67", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25348a2fd6ba43bbb3cf5e8126cd8a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25348a2fd6ba43bbb3cf5e8126cd8a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-VolumesSnapshotTestJSON-2048147728 Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 25348a2fd6ba43bbb3cf5e8126cd8a67 Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2048147728 Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-VolumesSnapshotTestJSON-2048147728-project Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 695bbf71deee465985055e79dc8e105e Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-VolumesSnapshotTestJSON-2048147728-project Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 could not be found. Aug 31 05:30:26.409188 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '7beb9d47-b838-41d6-b4ca-44c24a2ccad9'} Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 could not be found. Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:30:26.410187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 could not be found. Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 could not be found. Aug 31 05:30:26.411785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:30:26.413165 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Returning 404 to user: Instance 7beb9d47-b838-41d6-b4ca-44c24a2ccad9 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:30:26.413165 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-dcec218a-563e-49f6-8092-15411fbcdbc9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9" status: 404 len: 111 microversion: 2.1 time: 0.038399 Aug 31 05:30:26.413165 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 535/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:26 2022] GET /compute/v2.1/servers/7beb9d47-b838-41d6-b4ca-44c24a2ccad9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:30:37.404687 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:37.405842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:37.410309 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1091647143", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "networks": [{"uuid": "8c16c63a-ca61-4dcf-8ba9-b847ea686a8d"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:30:37.469404 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] validate_networks() for [('8c16c63a-ca61-4dcf-8ba9-b847ea686a8d', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:30:37.820594 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:30:37.821851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:30:37.822363 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:30:37.822763 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:30:37.823167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:30:37.833620 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:37.833989 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:37.834543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:37.835245 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:37.835675 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:37.836080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:37.853187 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Getting quotas for project 25348a2fd6ba43bbb3cf5e8126cd8a67. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:30:37.857239 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Getting quotas for user 695bbf71deee465985055e79dc8e105e and project 25348a2fd6ba43bbb3cf5e8126cd8a67. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:30:37.868148 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:30:37.870520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:30:37.916982 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-69aa3b6a-7324-4a85-89b1-5123065fe6b9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514023 Aug 31 05:30:37.917656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 536/1071] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:30:37.928611 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-31c383b3-3042-4b1f-9f2d-215d7c30c873 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:37.929208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-31c383b3-3042-4b1f-9f2d-215d7c30c873 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:37.931520 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=8 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:37.933427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:38.000895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-31c383b3-3042-4b1f-9f2d-215d7c30c873 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:38.008093 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-31c383b3-3042-4b1f-9f2d-215d7c30c873 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1219 microversion: 2.1 time: 0.083348 Aug 31 05:30:38.008835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 536/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:37 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:39.029393 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:39.030082 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:39.039637 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:39.040113 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:39.040538 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:39.041354 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:39.041800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:39.042384 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:39.112531 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:39.122340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a10dbdc2-db39-4cdc-b98a-682b6492f350 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1271 microversion: 2.1 time: 0.097276 Aug 31 05:30:39.123019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 537/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:39 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:40.144072 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:40.144598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:40.148427 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:30:40.148595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Wed Aug 31 05:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f (ip 10.222.0.36) !!! Aug 31 05:30:40.155825 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:40.156313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:40.156743 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:40.157446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:40.158172 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:40.158594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:40.355268 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:40.365292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-fa366c08-92e7-40bf-b9f1-a8b0acf5daf7 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1319 microversion: 2.1 time: 0.225214 Aug 31 05:30:40.367214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 537/1074] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:40 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:40.580185 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-0e4b5c68-4826-4543-8c85-96707708cab0 req-6db05b7c-8303-4842-a528-c8112ef0b378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08abb2cb-a96a-4556-b127-a556cf6ebf3f", "tag": "bc883657-f254-4b12-a862-399e74d6a502"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:30:40.592404 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0e4b5c68-4826-4543-8c85-96707708cab0 req-6db05b7c-8303-4842-a528-c8112ef0b378 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:40.594295 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0e4b5c68-4826-4543-8c85-96707708cab0 req-6db05b7c-8303-4842-a528-c8112ef0b378 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:40.594742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-0e4b5c68-4826-4543-8c85-96707708cab0 req-6db05b7c-8303-4842-a528-c8112ef0b378 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:40.609334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-0e4b5c68-4826-4543-8c85-96707708cab0 req-6db05b7c-8303-4842-a528-c8112ef0b378 service nova] Creating event network-changed:bc883657-f254-4b12-a862-399e74d6a502 for instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f on hv-cinder-85220 Aug 31 05:30:40.615741 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-0e4b5c68-4826-4543-8c85-96707708cab0 req-6db05b7c-8303-4842-a528-c8112ef0b378 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039415 Aug 31 05:30:40.616913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 538/1075] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:30:41.386619 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:41.387270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:41.393937 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:41.394468 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:41.394888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:41.395536 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:41.395974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:41.396439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:41.527882 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:41.535763 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5ed6df68-c1ad-4bd4-94f8-dd762cbc982a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1319 microversion: 2.1 time: 0.153162 Aug 31 05:30:41.536330 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 538/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:41 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:42.559524 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:42.560269 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:42.569262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:42.569734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:42.570186 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:42.570919 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:42.571296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:42.571705 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:42.703434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:42.711336 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-48c4a2ff-5a36-4008-881a-1bba195be4c5 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1319 microversion: 2.1 time: 0.157967 Aug 31 05:30:42.712151 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 539/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:42 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:43.735278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:43.735903 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:43.742449 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:43.742923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:43.743343 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:43.744039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:43.744477 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:43.744913 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:43.952319 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:43.960416 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0ada9672-f63a-4062-8b2a-48b12e6ddda3 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1319 microversion: 2.1 time: 0.229100 Aug 31 05:30:43.960974 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 539/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:43 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:44.983531 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:44.984353 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:44.991503 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:44.991986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:44.992409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:44.993103 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:44.993545 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:44.993956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:45.125584 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:45.135768 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9b7f2abc-62e3-41eb-a2f9-07e53f1bed8a tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1319 microversion: 2.1 time: 0.156499 Aug 31 05:30:45.136343 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 540/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:44 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:46.168741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:46.169637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:46.180680 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:46.181473 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:46.182210 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:46.183314 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:46.184043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:46.184736 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:46.318586 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:46.326725 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c9c98c37-d24b-46fb-82de-598271d629e8 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1319 microversion: 2.1 time: 0.164735 Aug 31 05:30:46.327325 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 540/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:46 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:47.017702 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-67140642-04fa-41cc-9565-4e573c600c3e req-36fbced4-bd70-4feb-a88d-e48dd1fe5fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08abb2cb-a96a-4556-b127-a556cf6ebf3f", "name": "network-vif-plugged", "status": "completed", "tag": "bc883657-f254-4b12-a862-399e74d6a502"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:30:47.027508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-67140642-04fa-41cc-9565-4e573c600c3e req-36fbced4-bd70-4feb-a88d-e48dd1fe5fe5 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:47.027960 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-67140642-04fa-41cc-9565-4e573c600c3e req-36fbced4-bd70-4feb-a88d-e48dd1fe5fe5 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:47.028378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-67140642-04fa-41cc-9565-4e573c600c3e req-36fbced4-bd70-4feb-a88d-e48dd1fe5fe5 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:47.039238 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-67140642-04fa-41cc-9565-4e573c600c3e req-36fbced4-bd70-4feb-a88d-e48dd1fe5fe5 service nova] Creating event network-vif-plugged:bc883657-f254-4b12-a862-399e74d6a502 for instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f on hv-cinder-85220 Aug 31 05:30:47.044113 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-67140642-04fa-41cc-9565-4e573c600c3e req-36fbced4-bd70-4feb-a88d-e48dd1fe5fe5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091825 Aug 31 05:30:47.044683 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 541/1081] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:30:47.351253 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:47.352083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:47.362698 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:47.363454 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:47.364123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:47.365165 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:47.365824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:47.366265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:47.518196 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:47.526531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-650ba9a2-341e-48fe-a585-9d7c010bec8e tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1319 microversion: 2.1 time: 0.181976 Aug 31 05:30:47.527086 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 541/1082] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:47 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:48.548678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:48.549963 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:48.558184 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:48.559330 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:48.570349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:48.570835 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:48.571263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:48.571967 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:48.572415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:48.572843 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:48.713329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:48.721362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a6460611-c992-416d-ba65-8ed0158050a9 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1319 microversion: 2.1 time: 0.174434 Aug 31 05:30:48.721922 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 542/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:48 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:49.745373 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:49.745940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:49.747957 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:30:49.753559 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:49.754032 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:49.754470 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:49.755138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:49.755561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:49.755970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:49.891331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:49.903435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6d606814-4f40-4888-be12-00798f84934b tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1509 microversion: 2.1 time: 0.162272 Aug 31 05:30:49.904196 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 542/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:49 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:49.925078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d3aa075-e6f6-4965-ab48-0a625e65bafb", "device": "/dev/sdb"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:30:49.927511 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:49.934688 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:49.935171 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:49.935597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:49.936281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:49.936732 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:49.937150 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:50.226500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9dffb206-5ed1-4fae-9aac-cb4ad43ed6ff tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "POST /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305182 Aug 31 05:30:50.227111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 543/1085] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:30:49 2022] POST /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:30:57.294925 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:57.295398 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:57.302175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:57.302645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:57.303072 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:57.303716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:57.304153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:57.304554 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:57.333843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ff081be8-be34-43c5-aea2-f7f1a732ced3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5/ips" status: 200 len: 149 microversion: 2.1 time: 0.042878 Aug 31 05:30:57.334459 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 543/1086] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:30:57 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:30:57.353074 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "162f007e-4cf1-4c3a-9308-0640e77967e9"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:30:57.355763 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:57.362424 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:57.362905 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:57.363328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:57.364014 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:57.364456 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:57.364875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:57.446765 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Invalid volume: volume 162f007e-4cf1-4c3a-9308-0640e77967e9 is already attached to instances: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5/os-volume_attachments HTTP/1.1 Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 74 Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:30:57.448604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {"volumeAttachment": {"volumeId": "162f007e-4cf1-4c3a-9308-0640e77967e9"}} Aug 31 05:30:57.450164 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Invalid volume: volume 162f007e-4cf1-4c3a-9308-0640e77967e9 is already attached to instances: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'server_id': '6525e687-14ff-454b-8ccc-59b82ab1b8d5', 'body': {'volumeAttachment': {'volumeId': '162f007e-4cf1-4c3a-9308-0640e77967e9'}}} Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 162f007e-4cf1-4c3a-9308-0640e77967e9 is already attached to instances: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:30:57.450996 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 162f007e-4cf1-4c3a-9308-0640e77967e9 is already attached to instances: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:30:57.452277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:30:57.453589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:30:57.453589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:30:57.453589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:30:57.453589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 162f007e-4cf1-4c3a-9308-0640e77967e9 is already attached to instances: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 Aug 31 05:30:57.453589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:30:57.453589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 400 to user: Invalid volume: volume 162f007e-4cf1-4c3a-9308-0640e77967e9 is already attached to instances: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:30:57.453589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-81874e8e-1f2d-4b24-ad03-464bc001c1cd tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107202 Aug 31 05:30:57.453589 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 544/1087] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:30:57 2022] POST /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:30:57.460213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:57.460730 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:57.466943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:57.467411 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:57.467828 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:57.468499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:57.468937 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:57.469344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:57.494956 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Going to try to terminate instance {{(pid=120607) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:30:57.574083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-80b78fd7-ee8a-4f99-9fd0-438625dde457 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 204 len: 0 microversion: 2.1 time: 0.117455 Aug 31 05:30:57.577864 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 544/1088] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:30:57 2022] DELETE /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:30:57.583401 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:57.583997 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:57.591578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:57.592055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:57.592477 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:57.593158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:57.593596 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:57.594034 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:57.726803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:57.734749 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6d4f5b2d-3f36-41d6-9e74-d61248345ae3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1681 microversion: 2.1 time: 0.155341 Aug 31 05:30:57.735310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 545/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:57 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:58.760256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:58.760936 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:58.767977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:58.768456 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:58.768886 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:58.769554 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:58.769992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:58.770428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:58.911174 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:30:58.919351 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2a2dbbad-8c22-491a-bcbd-e397dc035826 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1681 microversion: 2.1 time: 0.165667 Aug 31 05:30:58.919906 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 545/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:58 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:30:59.944716 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:30:59.945704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:30:59.956740 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:59.957488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:59.958396 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:30:59.959600 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:30:59.961024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:30:59.961024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:00.108762 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:00.116956 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d76b9a54-1a65-4760-b77f-ddd5e9769a9c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1681 microversion: 2.1 time: 0.178821 Aug 31 05:31:00.117541 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 546/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:30:59 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:01.140795 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:01.141486 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:01.149322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:01.149854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:01.150380 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:01.151126 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:01.151616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:01.152067 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:01.287027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:01.295208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8315fdee-6173-4a3b-b65a-f743e73e2623 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1681 microversion: 2.1 time: 0.159448 Aug 31 05:31:01.295777 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 546/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:01 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:02.320025 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:02.321745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:02.332475 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:02.333259 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:02.333957 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:02.335112 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:02.335835 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:02.336523 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:02.492326 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:02.502734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b2dbfeb5-a64a-42ca-9a6e-719994c94bb0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1681 microversion: 2.1 time: 0.188906 Aug 31 05:31:02.503658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 547/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:02 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:03.527758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:03.528511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:03.535498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:03.536010 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:03.536436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:03.537148 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:03.537589 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:03.538052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:03.789641 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:03.800316 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-016fbdcb-8a3c-4d74-8197-7cc0ec867525 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1681 microversion: 2.1 time: 0.276745 Aug 31 05:31:03.800924 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 547/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:03 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1681 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:04.243289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-fa558bb8-c575-480b-85c1-57ae1f5c90d3 req-11705ad0-520a-4786-a756-2cd7047d14c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6525e687-14ff-454b-8ccc-59b82ab1b8d5", "name": "network-vif-deleted", "tag": "acbd09ed-052a-48ac-a1a0-03eaaf3006ae"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:31:04.253880 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-fa558bb8-c575-480b-85c1-57ae1f5c90d3 req-11705ad0-520a-4786-a756-2cd7047d14c1 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:04.254386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-fa558bb8-c575-480b-85c1-57ae1f5c90d3 req-11705ad0-520a-4786-a756-2cd7047d14c1 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:04.254806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-fa558bb8-c575-480b-85c1-57ae1f5c90d3 req-11705ad0-520a-4786-a756-2cd7047d14c1 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:04.265864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-fa558bb8-c575-480b-85c1-57ae1f5c90d3 req-11705ad0-520a-4786-a756-2cd7047d14c1 service nova] Creating event network-vif-deleted:acbd09ed-052a-48ac-a1a0-03eaaf3006ae for instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 on hv-cinder-85220 Aug 31 05:31:04.278864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-fa558bb8-c575-480b-85c1-57ae1f5c90d3 req-11705ad0-520a-4786-a756-2cd7047d14c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039105 Aug 31 05:31:04.279797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 548/1095] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:31:04.825618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:04.826347 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:04.833440 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:04.833910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:04.834356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:04.835022 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:04.835460 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:04.835871 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:04.898640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:04.906495 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a9aa89e6-268b-456c-8ae6-d2679322db83 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1613 microversion: 2.1 time: 0.084952 Aug 31 05:31:04.907111 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 548/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:04 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:05.933312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:05.934530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:05.941340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:05.941809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:05.942262 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:05.942937 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:05.943376 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:05.943784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:06.013625 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:06.021958 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-58b9724d-fe79-44c2-8e8a-7d9577bdf4a2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1613 microversion: 2.1 time: 0.096524 Aug 31 05:31:06.022557 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 549/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:05 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:07.044719 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:07.045463 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:07.054571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:07.055195 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:07.055751 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:07.056633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:07.057219 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:07.057758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:07.128101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:07.136367 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-46fd582d-ea9d-4424-9bb8-18c2dc0d38c4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1326 microversion: 2.1 time: 0.096929 Aug 31 05:31:07.136927 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 549/1098] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:07 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:08.161512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:08.162533 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:08.166590 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:08.176063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:08.176935 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:08.177649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:08.178834 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:08.179571 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:08.180259 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:08.185107 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:08.214783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:08.215241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:08.215712 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:08.216137 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lazy-loading 'fault' on Instance uuid 6525e687-14ff-454b-8ccc-59b82ab1b8d5 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:31:08.258341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:08.267054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-18413a5e-072c-4e03-8cb8-d758b4224137 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 200 len: 1331 microversion: 2.1 time: 0.112227 Aug 31 05:31:08.267632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 550/1099] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:08 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:31:09.292288 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:09.293366 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:09.296112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:09.301444 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:09.301912 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:09.302354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:09.303020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:09.303459 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:09.303865 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:09.307068 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:09.319274 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 HTTP/1.1 Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:31:09.320911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:31:09.322681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '6525e687-14ff-454b-8ccc-59b82ab1b8d5'} Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:31:09.323657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:31:09.325243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:31:09.326824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:31:09.326824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f7fc35f9-3202-4cdc-9b0b-8d33d2af4502 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 404 len: 111 microversion: 2.1 time: 0.036572 Aug 31 05:31:09.326824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 550/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:09 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:31:09.332194 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7cca10e7-8c44-4683-9f66-0dafb0edfe99 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '.version_select at 0x7fbd0ea2eb80>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:09.353591 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7cca10e7-8c44-4683-9f66-0dafb0edfe99 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362263889" status: 202 len: 0 microversion: 2.1 time: 0.025268 Aug 31 05:31:09.354215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 551/1101] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 05:31:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362263889 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:31:10.057685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:10.058385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:10.067524 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:10.068270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:10.068870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:10.069736 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:10.070255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:10.070779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:10.161301 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lazy-loading 'services' on Instance uuid b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:31:10.247471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0b01ef99-1146-4992-b378-71def8bed832 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-volume_attachments/162f007e-4cf1-4c3a-9308-0640e77967e9" status: 202 len: 0 microversion: 2.1 time: 0.195466 Aug 31 05:31:10.248286 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 551/1102] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:31:10 2022] DELETE /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-volume_attachments/162f007e-4cf1-4c3a-9308-0640e77967e9 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:31:10.258536 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:10.260725 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:10.271679 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:10.272169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:10.272603 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:10.273290 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:10.273736 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:10.274179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:10.304519 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0b15e14e-1ee7-4f2f-9dec-7c243e386bb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050202 Aug 31 05:31:10.305081 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 552/1103] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:31:10 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:31:11.318296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:11.322264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:11.329293 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:11.329765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:11.330265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:11.330949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:11.331389 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:11.331804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:11.361615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b18efde3-e818-43d4-8070-f1fb315af628 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048167 Aug 31 05:31:11.362190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 552/1104] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:31:11 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:31:11.423607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:11.424154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:11.430901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:11.431384 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:11.431804 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:11.432484 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:11.432929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:11.433344 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:11.458987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:31:11.539611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-612e64ea-d092-46b5-a85d-d86e36bac707 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 204 len: 0 microversion: 2.1 time: 0.119576 Aug 31 05:31:11.540201 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 553/1105] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:31:11 2022] DELETE /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:31:11.549040 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:11.549635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:11.555706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:11.556176 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:11.556593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:11.557258 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:11.557691 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:11.558119 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:11.699542 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:11.708035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-dc76e4e3-182b-4f37-90a1-66b1f379b819 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1680 microversion: 2.1 time: 0.162995 Aug 31 05:31:11.708624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 553/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:11 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:11.772545 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:11.773115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:11.779334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:11.779809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:11.780225 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:11.780900 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:11.781334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:11.781738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:11.864631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lazy-loading 'services' on Instance uuid 08abb2cb-a96a-4556-b127-a556cf6ebf3f {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:31:11.944779 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f2165d3d-5732-4f89-962a-4bacf47bac2c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "DELETE /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f/os-volume_attachments/6d3aa075-e6f6-4965-ab48-0a625e65bafb" status: 202 len: 0 microversion: 2.1 time: 0.176331 Aug 31 05:31:11.945556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 554/1107] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:31:11 2022] DELETE /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f/os-volume_attachments/6d3aa075-e6f6-4965-ab48-0a625e65bafb => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:31:12.733975 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:12.735132 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:12.746208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:12.747000 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:12.747713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:12.748826 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:12.749302 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:12.749712 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:12.888539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:12.896962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-52da21cd-95ee-4789-a252-0a176a84cfb2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1680 microversion: 2.1 time: 0.169625 Aug 31 05:31:12.897571 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 554/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:12 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:13.918476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:13.919233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:13.926179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:13.926620 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:13.927042 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:13.927728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:13.928177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:13.928640 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:14.168019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:14.176095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5e00f3a4-a14d-494f-9d9b-3fa720ee8bcf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1680 microversion: 2.1 time: 0.262286 Aug 31 05:31:14.177296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 555/1109] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:13 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1680 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:14.980737 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-666b13f9-2751-47d6-b8d7-29885bc320dc req-885caf9d-cf2b-41da-80b1-0af94f7e4df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3", "name": "network-vif-deleted", "tag": "8a7fc778-1730-48b9-b81b-87ca459e7396"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:31:14.991499 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-666b13f9-2751-47d6-b8d7-29885bc320dc req-885caf9d-cf2b-41da-80b1-0af94f7e4df8 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:14.991963 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-666b13f9-2751-47d6-b8d7-29885bc320dc req-885caf9d-cf2b-41da-80b1-0af94f7e4df8 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:14.992374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-666b13f9-2751-47d6-b8d7-29885bc320dc req-885caf9d-cf2b-41da-80b1-0af94f7e4df8 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:15.005716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-666b13f9-2751-47d6-b8d7-29885bc320dc req-885caf9d-cf2b-41da-80b1-0af94f7e4df8 service nova] Creating event network-vif-deleted:8a7fc778-1730-48b9-b81b-87ca459e7396 for instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 on hv-cinder-85220 Aug 31 05:31:15.010904 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-666b13f9-2751-47d6-b8d7-29885bc320dc req-885caf9d-cf2b-41da-80b1-0af94f7e4df8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033883 Aug 31 05:31:15.011508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 555/1110] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:31:15.188434 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:15.189063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:15.200640 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:15.200993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:15.201126 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:15.201648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:15.202286 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:15.202409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:15.202753 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:15.203169 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:15.217216 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:15.217704 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:15.218204 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:15.219950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:15.220432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:15.220910 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:15.233011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:31:15.262133 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:15.262696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:15.263185 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:15.263682 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lazy-loading 'fault' on Instance uuid b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:31:15.314472 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:15.323951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-564e08a9-8026-4f26-96f7-1ed87023ad5f tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "DELETE /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 204 len: 0 microversion: 2.1 time: 0.140451 Aug 31 05:31:15.324178 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-9821bf52-fee8-4eea-9393-a40b53f23e32 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1329 microversion: 2.1 time: 0.129466 Aug 31 05:31:15.324800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 556/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:15 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1329 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:15.325356 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 556/1112] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:31:15 2022] DELETE /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:31:15.333446 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:15.334083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:15.340129 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:15.340597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:15.341025 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:15.341705 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:15.342211 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:15.342623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:15.476023 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:15.484336 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-da73b73c-cf2f-403d-ae2f-11667cd2ca9c tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1515 microversion: 2.1 time: 0.154823 Aug 31 05:31:15.484934 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 557/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:15 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:31:16.349186 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:16.349835 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:16.356917 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:16.357398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:16.357823 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:16.358535 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:16.358991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:16.359403 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:16.390523 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:16.390984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:16.391406 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:16.391839 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lazy-loading 'fault' on Instance uuid b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:31:16.434917 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:16.443061 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-5cd0f86c-698e-45be-8f7d-63d0d86de968 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 200 len: 1329 microversion: 2.1 time: 0.098495 Aug 31 05:31:16.444101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 557/1114] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:16 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 1329 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:16.505014 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:16.505612 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:16.512501 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:16.512971 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:16.513393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:16.514077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:16.514521 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:16.514926 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:16.648642 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:16.656777 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-98cb17d0-d5a2-42d1-8736-71cf9895429d tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1515 microversion: 2.1 time: 0.155692 Aug 31 05:31:16.657378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 558/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:16 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:17.465211 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:17.465803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:17.472995 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:17.474036 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:17.474484 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:17.475470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:17.476076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:17.476667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:17.492349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 HTTP/1.1 Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:31:17.494072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:31:17.495752 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3'} Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:31:17.496690 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:31:17.498226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:17.499952 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:31:17.499952 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d14fb2d4-987d-4e7a-bf98-d2c9a3c762e7 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 404 len: 111 microversion: 2.1 time: 0.035231 Aug 31 05:31:17.499952 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 558/1116] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:17 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:31:17.504727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-17495a06-2101-42d6-81d5-56c8781f2b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '.version_select at 0x7fbd0b6e9310>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:17.509124 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17495a06-2101-42d6-81d5-56c8781f2b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [01316a26-b6f3-4a66-8744-baf401be69d9] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 05:31:17.678451 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:17.679047 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:17.685281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:17.685730 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:17.686189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:17.686858 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:17.687341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:17.687746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:17.889932 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695bbf71deee465985055e79dc8e105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25348a2fd6ba43bbb3cf5e8126cd8a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:17.898605 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-27b1f37e-e604-4302-b334-2628cf217d50 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 200 len: 1515 microversion: 2.1 time: 0.224096 Aug 31 05:31:17.899189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 559/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:17 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:17.940821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-fed949ca-dc6b-4e9c-8db6-5fefecbd4406 req-4cf591b4-0651-4f52-8955-e156a09c0664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08abb2cb-a96a-4556-b127-a556cf6ebf3f", "name": "network-vif-deleted", "tag": "bc883657-f254-4b12-a862-399e74d6a502"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:31:17.952059 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-fed949ca-dc6b-4e9c-8db6-5fefecbd4406 req-4cf591b4-0651-4f52-8955-e156a09c0664 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:17.952525 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-fed949ca-dc6b-4e9c-8db6-5fefecbd4406 req-4cf591b4-0651-4f52-8955-e156a09c0664 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:17.952938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-fed949ca-dc6b-4e9c-8db6-5fefecbd4406 req-4cf591b4-0651-4f52-8955-e156a09c0664 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:17.964542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-fed949ca-dc6b-4e9c-8db6-5fefecbd4406 req-4cf591b4-0651-4f52-8955-e156a09c0664 service nova] Creating event network-vif-deleted:bc883657-f254-4b12-a862-399e74d6a502 for instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f on hv-cinder-85220 Aug 31 05:31:17.969578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-fed949ca-dc6b-4e9c-8db6-5fefecbd4406 req-4cf591b4-0651-4f52-8955-e156a09c0664 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032588 Aug 31 05:31:17.970221 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 560/1118] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:31:18.517168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [None req-17495a06-2101-42d6-81d5-56c8781f2b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [01316a26-b6f3-4a66-8744-baf401be69d9] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46146. Aug 31 05:31:18.538354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-17495a06-2101-42d6-81d5-56c8781f2b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-689796341" status: 202 len: 0 microversion: 2.1 time: 1.037410 Aug 31 05:31:18.539367 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 559/1119] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Aug 31 05:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-689796341 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:31:18.921435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:18.922147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] [instance: 08abb2cb-a96a-4556-b127-a556cf6ebf3f] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:18.928969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:18.928969 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:18.929339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:18.929925 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:18.930409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:18.930814 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:18.944334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] HTTP exception thrown: Instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f could not be found. Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Request method failure captured: Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f HTTP/1.1 Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvGl3hTEKZbnNCvvnrmrU9I4Lvrn9hSBP_byw5nSQtkygM628Y6tbwERGBzyYgNF9hnYDTpX6-do1jXmC2aQOllVh_QdhJZa3Voss0mGsMACFkOvURYM6NTyQYTY1lOKOrFxKjQC5Xx_z80WCo97KWhJh_-fcUeyiKyBJtPY0bSe4pk Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 25348a2fd6ba43bbb3cf5e8126cd8a67 Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2048147728 Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:31:18.945874 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25348a2fd6ba43bbb3cf5e8126cd8a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25348a2fd6ba43bbb3cf5e8126cd8a67", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25348a2fd6ba43bbb3cf5e8126cd8a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25348a2fd6ba43bbb3cf5e8126cd8a67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-VolumesSnapshotTestJSON-2048147728 Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 25348a2fd6ba43bbb3cf5e8126cd8a67 Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2048147728 Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-VolumesSnapshotTestJSON-2048147728-project Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 695bbf71deee465985055e79dc8e105e Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-VolumesSnapshotTestJSON-2048147728-project Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f could not be found. Aug 31 05:31:18.947500 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '08abb2cb-a96a-4556-b127-a556cf6ebf3f'} Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f could not be found. Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:31:18.948464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f could not be found. Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f could not be found. Aug 31 05:31:18.949801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:31:18.950993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] Returning 404 to user: Instance 08abb2cb-a96a-4556-b127-a556cf6ebf3f could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:31:18.950993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1771b870-21ac-4522-aa3a-06ca96233847 tempest-VolumesSnapshotTestJSON-2048147728 tempest-VolumesSnapshotTestJSON-2048147728-project] 10.222.0.36 "GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f" status: 404 len: 111 microversion: 2.1 time: 0.030724 Aug 31 05:31:18.950993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 561/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:18 2022] GET /compute/v2.1/servers/08abb2cb-a96a-4556-b127-a556cf6ebf3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:31:19.178633 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-3c7d9377-16c2-47c1-8851-3cee7f0208cb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: .version_select at 0x7fbd0eb10af0>, body: {"keypair": {"name": "tempest-keypair-1953092691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYk38ZN7WxYR9U0V6LyNGl7G08959IAiK9aOR+E/1yZqbdscYCZFLeXnktTCw+K8YkF1TbPYKG9h7uY7mErLGXoM/iixY5MjcgSFEzPmZ91FtNb/U2dexuYG16Ay2XUsg=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:31:19.196900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-3c7d9377-16c2-47c1-8851-3cee7f0208cb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:31:19.200717 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-3c7d9377-16c2-47c1-8851-3cee7f0208cb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for user b0f728c7e4074084be1a433ae14879b8 and project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:31:19.226190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-3c7d9377-16c2-47c1-8851-3cee7f0208cb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051836 Aug 31 05:31:19.227233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 560/1121] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:31:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:31:20.537574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1659009345", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "475a74f0-6918-4e96-839d-657934d65631"}], "security_groups": [{"name": "tempest-securitygroup--1226768811"}], "key_name": "tempest-keypair-1953092691", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:31:20.647242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] validate_networks() for [('475a74f0-6918-4e96-839d-657934d65631', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:31:21.130641 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:31:21.131248 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:31:21.131934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:31:21.132519 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:31:21.133112 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:31:21.144984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:21.145428 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:21.145850 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:21.146588 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:21.147024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:21.147432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:21.164586 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:31:21.169100 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for user b0f728c7e4074084be1a433ae14879b8 and project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:31:21.181336 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:31:21.183631 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:31:21.232051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cb87078e-6164-4b64-94d7-4ee8c55a62e3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.698954 Aug 31 05:31:21.232738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 562/1122] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:31:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:31:21.244169 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2e146758-d222-48cb-899b-f26f082bc60b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:21.244744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2e146758-d222-48cb-899b-f26f082bc60b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:21.299182 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2e146758-d222-48cb-899b-f26f082bc60b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:21.306841 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2e146758-d222-48cb-899b-f26f082bc60b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1242 microversion: 2.1 time: 0.067057 Aug 31 05:31:21.307399 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 561/1123] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:21 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:22.332966 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:22.333934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:22.344943 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:22.345420 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:22.345849 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:22.346566 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:22.347011 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:22.347461 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:22.419503 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:22.431172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7506ffb4-367e-4d4a-b92d-d823a815f17e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1246 microversion: 2.1 time: 0.105652 Aug 31 05:31:22.431903 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 563/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:22 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:23.458474 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:23.459400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:23.470497 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:23.471313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:23.472020 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:23.473123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:23.474261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:23.474933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:23.543228 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:23.551449 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cc4d1cb5-6884-4e17-922e-67012129387c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1246 microversion: 2.1 time: 0.099766 Aug 31 05:31:23.552021 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 562/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:23 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:24.571317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:24.572554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:24.579458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:24.579930 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:24.580649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:24.581405 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:24.582218 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:24.582904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:24.650217 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:24.662044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-adf2c3fd-580d-4afa-ac66-04a19b658e00 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1294 microversion: 2.1 time: 0.094478 Aug 31 05:31:24.662975 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 564/1126] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:24 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:25.682773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:25.683339 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:25.691041 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:25.691426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:25.691843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:25.692520 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:25.692949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:25.693335 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:25.885612 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:25.893997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2dd9410d-0478-43db-9954-8c37ca65ac9f tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.215096 Aug 31 05:31:25.894552 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 563/1127] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:25 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:26.161757 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-7770b180-8ad5-4da4-9366-cb528619b303 req-f75f7ad5-bd36-4ad1-8298-cda89b2037ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c5151f-3e47-4ee6-97c2-78b8d8c6a723", "tag": "84a32c85-1f20-43af-b352-bdeb2e06025d"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:31:26.172455 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7770b180-8ad5-4da4-9366-cb528619b303 req-f75f7ad5-bd36-4ad1-8298-cda89b2037ef service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:26.173228 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7770b180-8ad5-4da4-9366-cb528619b303 req-f75f7ad5-bd36-4ad1-8298-cda89b2037ef service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:26.173847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7770b180-8ad5-4da4-9366-cb528619b303 req-f75f7ad5-bd36-4ad1-8298-cda89b2037ef service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:26.338654 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-7770b180-8ad5-4da4-9366-cb528619b303 req-f75f7ad5-bd36-4ad1-8298-cda89b2037ef service nova] Creating event network-changed:84a32c85-1f20-43af-b352-bdeb2e06025d for instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 on hv-cinder-85220 Aug 31 05:31:26.343939 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-7770b180-8ad5-4da4-9366-cb528619b303 req-f75f7ad5-bd36-4ad1-8298-cda89b2037ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186349 Aug 31 05:31:26.344905 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 565/1128] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:31:26.916939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:26.917809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:26.926512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:26.927153 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:26.927686 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:26.928538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:26.929097 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:26.929618 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:27.072824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:27.083120 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5c4732da-a008-43c0-bfe8-6473f477ebee tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.171156 Aug 31 05:31:27.083703 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 564/1129] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:26 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:28.110076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:28.110988 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:28.119041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:28.119656 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:28.120175 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:28.121003 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:28.121519 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:28.122071 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:28.140198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:28.262357 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:28.270155 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-094a035c-f932-4ee9-9199-b6d37400696b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.167976 Aug 31 05:31:28.270715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 566/1130] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:28 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:29.294229 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:29.295105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:29.306073 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:29.306919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:29.307626 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:29.308739 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:29.309474 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:29.310214 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:29.443621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:29.451480 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-12a91d49-ebd0-472d-90aa-bff6e5833a8b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.163885 Aug 31 05:31:29.452051 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 565/1131] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:29 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:30.471909 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:30.472480 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:30.479749 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:30.480232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:30.480659 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:30.481349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:30.481795 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:30.482248 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:30.619548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:30.628022 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ca3c1cf3-292a-418e-bdf7-2c9f2a1d025c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.160418 Aug 31 05:31:30.628575 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 567/1132] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:30 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:31.649131 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:31.649706 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:31.652194 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:31.658187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:31.658682 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:31.659100 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:31.659769 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:31.660202 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:31.660607 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:31.789702 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:31.798650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-a67841b3-b0c4-4b1b-8367-6760b7280a82 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.153579 Aug 31 05:31:31.799225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 566/1133] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:31 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:32.823786 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:32.824704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:32.829437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:32.831271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:32.839842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:32.840568 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:32.841213 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:32.842282 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:32.842959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:32.843550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:32.978611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:32.986633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ea8da17e-b377-4f17-950e-01198ace13fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.169586 Aug 31 05:31:32.987193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 568/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:32 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:34.007228 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:34.007897 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:34.014617 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:34.015091 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:34.015513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:34.016184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:34.016691 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:34.017097 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:34.148591 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:34.156727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ac42163f-f5e6-4759-8ec7-ac87f37a9aa3 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.153247 Aug 31 05:31:34.157326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 567/1135] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:34 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:34.963102 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-7a16d01c-c91f-4dc3-b86a-0f163fd22371 req-48d439da-d4b2-453e-8930-e2ec299d0089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c5151f-3e47-4ee6-97c2-78b8d8c6a723", "name": "network-vif-plugged", "status": "completed", "tag": "84a32c85-1f20-43af-b352-bdeb2e06025d"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:31:34.973168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7a16d01c-c91f-4dc3-b86a-0f163fd22371 req-48d439da-d4b2-453e-8930-e2ec299d0089 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:34.973724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7a16d01c-c91f-4dc3-b86a-0f163fd22371 req-48d439da-d4b2-453e-8930-e2ec299d0089 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:34.974454 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-7a16d01c-c91f-4dc3-b86a-0f163fd22371 req-48d439da-d4b2-453e-8930-e2ec299d0089 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:34.985731 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-7a16d01c-c91f-4dc3-b86a-0f163fd22371 req-48d439da-d4b2-453e-8930-e2ec299d0089 service nova] Creating event network-vif-plugged:84a32c85-1f20-43af-b352-bdeb2e06025d for instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 on hv-cinder-85220 Aug 31 05:31:34.990832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-7a16d01c-c91f-4dc3-b86a-0f163fd22371 req-48d439da-d4b2-453e-8930-e2ec299d0089 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031628 Aug 31 05:31:34.991410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 569/1136] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:31:35.179803 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:35.180376 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:35.189901 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:35.190409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:35.190885 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:35.191481 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:35.191941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:35.192370 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:35.359758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:35.367789 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f51f0909-af5d-4d2e-8cc6-e285edd29b43 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.194237 Aug 31 05:31:35.368378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 568/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:35 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:36.394084 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:36.395246 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:36.405810 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:36.406635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:36.407394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:36.408496 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:36.409224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:36.409951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:36.551567 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:36.559569 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1ba8ee62-308f-4481-a933-02925afa1757 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1368 microversion: 2.1 time: 0.173346 Aug 31 05:31:36.560145 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 570/1138] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:36 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:37.583891 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:37.584507 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:37.591336 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:37.591835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:37.592235 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:37.592911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:37.593358 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:37.593766 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:37.731600 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:31:37.739407 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1f915c4b-15a4-4e9a-80d0-e7bd8a5865a0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1559 microversion: 2.1 time: 0.161547 Aug 31 05:31:37.739966 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 569/1139] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:31:37 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:31:37.759353 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:31:37.759864 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:31:37.766334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:37.766806 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:37.767263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:37.767938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:37.768379 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:37.768793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:37.847217 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-84566ea8-eedb-4f0d-a988-264cf1578d08 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091740 Aug 31 05:31:37.847814 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 571/1140] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 05:31:37 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:31:39.056983 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-035b3c81-2af9-4539-926c-f50686af72d8 req-3310df08-2167-4906-9399-9e5cb4ac7318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c5151f-3e47-4ee6-97c2-78b8d8c6a723", "tag": "84a32c85-1f20-43af-b352-bdeb2e06025d"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:31:39.066696 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-035b3c81-2af9-4539-926c-f50686af72d8 req-3310df08-2167-4906-9399-9e5cb4ac7318 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:31:39.067229 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-035b3c81-2af9-4539-926c-f50686af72d8 req-3310df08-2167-4906-9399-9e5cb4ac7318 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:31:39.067741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-035b3c81-2af9-4539-926c-f50686af72d8 req-3310df08-2167-4906-9399-9e5cb4ac7318 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:31:39.070400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:31:39.080508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-035b3c81-2af9-4539-926c-f50686af72d8 req-3310df08-2167-4906-9399-9e5cb4ac7318 service nova] Creating event network-changed:84a32c85-1f20-43af-b352-bdeb2e06025d for instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 on hv-cinder-85220 Aug 31 05:31:39.085941 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-035b3c81-2af9-4539-926c-f50686af72d8 req-3310df08-2167-4906-9399-9e5cb4ac7318 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032838 Aug 31 05:31:39.086643 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 570/1141] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:32:54.458413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:32:54.459172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=27 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:32:54.640127 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:32:54.640743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:32:54.647274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:32:54.647750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:32:54.648179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:32:54.648870 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:32:54.649312 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:32:54.649724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:32:54.675249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6b0372a6-796c-4a06-9ee2-e147ba6242df tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/ips" status: 200 len: 151 microversion: 2.1 time: 0.220624 Aug 31 05:32:54.681342 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 572/1142] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:32:54 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/ips => generated 151 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:32:56.026692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:32:56.027428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:32:56.032939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e7caa3e-d493-4fa1-991d-2d0794036891"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:32:56.035374 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:32:56.043307 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:32:56.043784 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:32:56.044208 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:32:56.044892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:32:56.045331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:32:56.045742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:32:56.330644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7dc95853-cd9e-4a1f-b8be-a3432e7d4d66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305386 Aug 31 05:32:56.331528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 571/1143] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:32:56 2022] POST /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:33:04.084371 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e7caa3e-d493-4fa1-991d-2d0794036891"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:33:04.086750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:04.093027 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:04.093502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:04.093928 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:04.094633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:04.095070 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:04.095475 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:04.175224 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Invalid volume: volume 7e7caa3e-d493-4fa1-991d-2d0794036891 is already attached to instances: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: POST /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments HTTP/1.1 Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 74 Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:33:04.176897 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {"volumeAttachment": {"volumeId": "7e7caa3e-d493-4fa1-991d-2d0794036891"}} Aug 31 05:33:04.178611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Invalid volume: volume 7e7caa3e-d493-4fa1-991d-2d0794036891 is already attached to instances: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'server_id': 'e1c5151f-3e47-4ee6-97c2-78b8d8c6a723', 'body': {'volumeAttachment': {'volumeId': '7e7caa3e-d493-4fa1-991d-2d0794036891'}}} Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7e7caa3e-d493-4fa1-991d-2d0794036891 is already attached to instances: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:33:04.179580 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7e7caa3e-d493-4fa1-991d-2d0794036891 is already attached to instances: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:33:04.181124 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:33:04.182715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:33:04.182715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:33:04.182715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:33:04.182715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7e7caa3e-d493-4fa1-991d-2d0794036891 is already attached to instances: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 Aug 31 05:33:04.182715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:33:04.182715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 400 to user: Invalid volume: volume 7e7caa3e-d493-4fa1-991d-2d0794036891 is already attached to instances: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:33:04.182715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-269745b2-476e-4ff5-b4a0-46d39d0adee9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098187 Aug 31 05:33:04.182715 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 573/1144] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:33:04 2022] POST /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 05:33:04.242096 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:04.242637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:04.249580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:04.250052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:04.250508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:04.251186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:04.251627 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:04.252039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:04.337515 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lazy-loading 'services' on Instance uuid e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:33:04.412205 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-34654af1-2c51-40bf-867b-5136a6e7c51a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments/7e7caa3e-d493-4fa1-991d-2d0794036891" status: 202 len: 0 microversion: 2.1 time: 0.174597 Aug 31 05:33:04.412790 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 572/1145] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:33:04 2022] DELETE /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments/7e7caa3e-d493-4fa1-991d-2d0794036891 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:33:04.421591 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:04.423856 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:04.429904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:04.430415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:04.430837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:04.431523 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:04.431998 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:04.432432 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:04.462788 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-4d64f609-f182-4191-a5a8-d87285c2ab09 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Aug 31 05:33:04.463663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 574/1146] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:33:04 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:33:05.481098 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:05.483765 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:05.491434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:05.491978 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:05.492472 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:05.494192 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:05.494192 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:05.494192 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:05.532448 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2b2a0f8f-a1b5-4356-bea2-e9c39a4102f9 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058854 Aug 31 05:33:05.533014 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 573/1147] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:33:05 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:33:05.598468 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:05.599296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:05.609427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:05.610212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:05.610851 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:05.611915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:05.612554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:05.613152 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:05.640198 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:33:05.725585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-825a1299-11e2-409f-be5e-0d43baf4b735 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 204 len: 0 microversion: 2.1 time: 0.132703 Aug 31 05:33:05.726252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 575/1148] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:33:05 2022] DELETE /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:33:05.735310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:05.735836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:05.741965 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:05.742458 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:05.742890 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:05.743672 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:05.744104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:05.744511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:05.883027 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:05.891266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-16f4fc18-0bcf-49fb-bca9-8f6b8593b21a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1684 microversion: 2.1 time: 0.159966 Aug 31 05:33:05.891844 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 574/1149] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:05 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:06.916908 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:06.917508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:06.924464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:06.924935 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:06.925362 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:06.926046 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:06.926506 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:06.926915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:07.067111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:07.075249 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-93ea5c75-f7c2-4bb4-baf0-f1741390416e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1684 microversion: 2.1 time: 0.164972 Aug 31 05:33:07.075813 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 576/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:06 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:08.095837 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:08.096473 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:08.103957 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:08.104438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:08.104871 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:08.105553 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:08.105994 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:08.106434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:08.194906 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:08.203606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-91b852a6-d09a-4eba-a34b-03f33ae7f91d tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 200 len: 1616 microversion: 2.1 time: 0.111661 Aug 31 05:33:08.204525 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 575/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:08 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 1616 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:08.464875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-87643c44-bcd1-4016-9e46-e387f1d21b17 req-325a2f6a-a916-4d01-8020-36741d1d87ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c5151f-3e47-4ee6-97c2-78b8d8c6a723", "name": "network-vif-deleted", "tag": "84a32c85-1f20-43af-b352-bdeb2e06025d"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:33:08.476854 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-87643c44-bcd1-4016-9e46-e387f1d21b17 req-325a2f6a-a916-4d01-8020-36741d1d87ce service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:08.477599 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-87643c44-bcd1-4016-9e46-e387f1d21b17 req-325a2f6a-a916-4d01-8020-36741d1d87ce service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:08.478092 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-87643c44-bcd1-4016-9e46-e387f1d21b17 req-325a2f6a-a916-4d01-8020-36741d1d87ce service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:08.496032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-87643c44-bcd1-4016-9e46-e387f1d21b17 req-325a2f6a-a916-4d01-8020-36741d1d87ce service nova] Creating event network-vif-deleted:84a32c85-1f20-43af-b352-bdeb2e06025d for instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 on hv-cinder-85220 Aug 31 05:33:08.503289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-87643c44-bcd1-4016-9e46-e387f1d21b17 req-325a2f6a-a916-4d01-8020-36741d1d87ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042386 Aug 31 05:33:08.503894 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 577/1152] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:33:09.224805 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:09.226050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:09.233190 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:09.233920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:09.234378 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:09.235075 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:09.235509 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:09.235912 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:09.249940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 HTTP/1.1 Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:33:09.251645 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:33:09.253168 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': 'e1c5151f-3e47-4ee6-97c2-78b8d8c6a723'} Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:33:09.253993 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:33:09.255396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:33:09.256595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:33:09.256595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6b97cc70-858b-4677-84ec-8b6c50fcb7fe tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 404 len: 111 microversion: 2.1 time: 0.032126 Aug 31 05:33:09.256595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 576/1153] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:09 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:33:09.262899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b014eeda-0e28-42d3-8fb8-aa539b190b94 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '.version_select at 0x7fbd0eb1c550>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:09.284260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b014eeda-0e28-42d3-8fb8-aa539b190b94 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1953092691" status: 202 len: 0 microversion: 2.1 time: 0.025620 Aug 31 05:33:09.285125 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 578/1154] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 05:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1953092691 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:33:09.938338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-50baca9b-a23d-4c37-a4f4-9f3603d2927b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: .version_select at 0x7fbd0b3ed160>, body: {"keypair": {"name": "tempest-keypair-1469994130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLd7Jde7JFocChsb3D678PilDJL6KwSII7Rgboh5n02TVzEEVU7spyaKAF5RZJdJ8oj2U0Vc/ySSgJjhN55FL2IS/ADLnUhChTO/EHnuDt6e/3bW8M3s09RTofXfOkCAFA=="}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:33:09.955035 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-50baca9b-a23d-4c37-a4f4-9f3603d2927b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:33:09.959187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-50baca9b-a23d-4c37-a4f4-9f3603d2927b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for user b0f728c7e4074084be1a433ae14879b8 and project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'key_pairs'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:33:09.983836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-50baca9b-a23d-4c37-a4f4-9f3603d2927b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049557 Aug 31 05:33:09.984471 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 577/1155] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:33:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:33:11.270563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1265960327", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "475a74f0-6918-4e96-839d-657934d65631"}], "security_groups": [{"name": "tempest-securitygroup--1490044458"}], "key_name": "tempest-keypair-1469994130", "user_data": "}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:33:11.380474 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] validate_networks() for [('475a74f0-6918-4e96-839d-657934d65631', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:33:11.751183 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:33:11.751591 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:33:11.752048 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:33:11.752436 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:33:11.752832 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:33:11.762032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:11.762512 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:11.762935 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:11.763632 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:11.764078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:11.764485 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:11.780986 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:33:11.785118 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Getting quotas for user b0f728c7e4074084be1a433ae14879b8 and project cb164f6efb1d4047b9a5ca77f2ff44a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:33:11.796373 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:33:11.798724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:33:11.846524 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bb24d46b-0ac6-4f7e-8e84-8dfbe0254b8e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580882 Aug 31 05:33:11.847174 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 579/1156] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:33:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:33:11.859328 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-66080a9f-0616-4924-b003-f6eb21fa72cc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:11.859892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-66080a9f-0616-4924-b003-f6eb21fa72cc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:11.916137 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-66080a9f-0616-4924-b003-f6eb21fa72cc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:11.923122 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-66080a9f-0616-4924-b003-f6eb21fa72cc tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1242 microversion: 2.1 time: 0.068250 Aug 31 05:33:11.923685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 578/1157] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:11 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:12.945111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-319026f7-c414-428a-9fa8-2c3f0b58e1b0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:12.945697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-319026f7-c414-428a-9fa8-2c3f0b58e1b0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:13.003963 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-319026f7-c414-428a-9fa8-2c3f0b58e1b0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:13.011044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-319026f7-c414-428a-9fa8-2c3f0b58e1b0 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1242 microversion: 2.1 time: 0.071267 Aug 31 05:33:13.011620 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 580/1158] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:12 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:14.031594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5aa77f7c-77ca-47b1-b902-2dbc4a78dadf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:14.032234 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5aa77f7c-77ca-47b1-b902-2dbc4a78dadf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:14.087632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5aa77f7c-77ca-47b1-b902-2dbc4a78dadf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:14.094691 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5aa77f7c-77ca-47b1-b902-2dbc4a78dadf tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1242 microversion: 2.1 time: 0.067040 Aug 31 05:33:14.095284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 579/1159] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:14 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:15.119613 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-643ec511-e0a5-4b91-945f-39d9f2061678 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:15.120544 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-643ec511-e0a5-4b91-945f-39d9f2061678 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:15.181323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-643ec511-e0a5-4b91-945f-39d9f2061678 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:15.188165 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-643ec511-e0a5-4b91-945f-39d9f2061678 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1242 microversion: 2.1 time: 0.075177 Aug 31 05:33:15.188727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 581/1160] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:15 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:16.213537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:16.214300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:16.222938 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:16.223498 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:16.224038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:16.224828 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:16.225356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:16.225854 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:16.289184 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:16.296962 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cc110085-e4cd-4f02-8422-bd8805386f84 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1246 microversion: 2.1 time: 0.089612 Aug 31 05:33:16.297543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 580/1161] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:16 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:17.321398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:17.322390 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:17.329787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:17.330290 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:17.330697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:17.331421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:17.331860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:17.332241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:17.650467 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:17.658848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8a094e67-1289-4c15-a987-e8d0a36a5a66 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1300 microversion: 2.1 time: 0.344041 Aug 31 05:33:17.659493 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 582/1162] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:17 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1300 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:18.680611 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:18.681220 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:18.688180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:18.688657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:18.689086 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:18.689870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:18.690364 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:18.690780 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:18.748834 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-380051ff-2e91-4510-9330-9a2c69e27e42 req-f3bbd535-54db-4077-9ef6-a09eb333dbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1991abd1-003e-4533-b027-b0d3a1cc3ce4", "tag": "3cd54456-cb27-41a8-80f8-a3fb44e52388"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:33:18.758310 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-380051ff-2e91-4510-9330-9a2c69e27e42 req-f3bbd535-54db-4077-9ef6-a09eb333dbd6 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:18.758774 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-380051ff-2e91-4510-9330-9a2c69e27e42 req-f3bbd535-54db-4077-9ef6-a09eb333dbd6 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:18.759185 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-380051ff-2e91-4510-9330-9a2c69e27e42 req-f3bbd535-54db-4077-9ef6-a09eb333dbd6 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:18.771370 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-380051ff-2e91-4510-9330-9a2c69e27e42 req-f3bbd535-54db-4077-9ef6-a09eb333dbd6 service nova] Creating event network-changed:3cd54456-cb27-41a8-80f8-a3fb44e52388 for instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 on hv-cinder-85220 Aug 31 05:33:18.776993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-380051ff-2e91-4510-9330-9a2c69e27e42 req-f3bbd535-54db-4077-9ef6-a09eb333dbd6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031828 Aug 31 05:33:18.777885 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 583/1163] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:33:18.926343 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:18.934644 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c0b35c19-b0b5-4a40-90fa-3282bd3b8443 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1368 microversion: 2.1 time: 0.258375 Aug 31 05:33:18.935241 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 581/1164] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:18 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:19.960856 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:19.961809 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:19.969635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:19.970167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:19.970584 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:19.971258 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:19.971695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:19.972098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:20.117618 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:20.125579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-60e5fcb0-e3f7-4913-80a4-b71466b2b17a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1368 microversion: 2.1 time: 0.172175 Aug 31 05:33:20.126163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 584/1165] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:19 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:21.147305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:21.147887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:21.154759 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:21.155227 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:21.155632 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:21.156313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:21.156743 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:21.157412 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:21.367574 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:21.375748 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-596984a3-f95c-41ef-b8ed-008fe7a65022 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1368 microversion: 2.1 time: 0.232458 Aug 31 05:33:21.376403 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 582/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:21 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:22.400905 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:22.401840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:22.405821 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:33:22.414881 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:22.415686 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:22.416382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:22.417467 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:22.417902 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:22.418343 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:22.550168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:22.557869 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-efe0e584-ad54-4fc5-8677-2707019c69e6 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1368 microversion: 2.1 time: 0.163568 Aug 31 05:33:22.558474 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 585/1167] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:22 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:23.578323 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:23.578919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:23.586300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:23.586814 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:23.587243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:23.587957 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:23.588404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:23.588856 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:23.747722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:23.755990 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c25664ac-c34d-485c-a678-c8299b44b45c tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1368 microversion: 2.1 time: 0.181693 Aug 31 05:33:23.756569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 583/1168] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:23 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:24.781138 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:24.782067 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:24.785699 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:33:24.794385 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:24.794855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:24.795276 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:24.795946 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:24.796381 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:24.796783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:24.799833 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:33:24.927179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:24.935378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1233d455-bccd-4a33-985e-ba16e95f0dbb tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1368 microversion: 2.1 time: 0.160680 Aug 31 05:33:24.935937 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 586/1169] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:24 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:25.444050 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-a4690f97-aaf0-48e9-9875-4845a630370c req-b335a2a7-7c7a-4890-9a6f-62a38fd28d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1991abd1-003e-4533-b027-b0d3a1cc3ce4", "name": "network-vif-plugged", "status": "completed", "tag": "3cd54456-cb27-41a8-80f8-a3fb44e52388"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:33:25.454935 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=8 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:33:25.463257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a4690f97-aaf0-48e9-9875-4845a630370c req-b335a2a7-7c7a-4890-9a6f-62a38fd28d4d service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:25.463809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a4690f97-aaf0-48e9-9875-4845a630370c req-b335a2a7-7c7a-4890-9a6f-62a38fd28d4d service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:25.464223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a4690f97-aaf0-48e9-9875-4845a630370c req-b335a2a7-7c7a-4890-9a6f-62a38fd28d4d service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:25.475602 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-a4690f97-aaf0-48e9-9875-4845a630370c req-b335a2a7-7c7a-4890-9a6f-62a38fd28d4d service nova] Creating event network-vif-plugged:3cd54456-cb27-41a8-80f8-a3fb44e52388 for instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 on hv-cinder-85220 Aug 31 05:33:25.481038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-a4690f97-aaf0-48e9-9875-4845a630370c req-b335a2a7-7c7a-4890-9a6f-62a38fd28d4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041253 Aug 31 05:33:25.481638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 584/1170] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:33:25.960347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:25.961309 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:25.964248 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=10 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:33:25.970499 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:25.970972 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:25.971399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:25.972079 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:25.972525 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:25.972942 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:26.105701 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:26.113574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-bdebed2e-6c8d-4ea4-834b-29a61d52e9d8 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1368 microversion: 2.1 time: 0.159793 Aug 31 05:33:26.114177 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 587/1171] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:25 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:27.139278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:27.139988 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:27.142508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:33:27.148754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:27.149244 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:27.149669 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:27.150409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:27.150845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:27.151256 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:27.155639 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:33:27.292511 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:27.300727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-377a3c75-ae8f-4523-8f90-44889c77598e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1368 microversion: 2.1 time: 0.168501 Aug 31 05:33:27.301321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 585/1172] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:27 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:28.321325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:28.322553 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:28.329288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:28.329769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:28.330274 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:28.330966 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:28.331411 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:28.331828 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:28.486607 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:33:28.499646 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e2120b3b-111d-49f3-bf67-3c91479ae30a tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1558 microversion: 2.1 time: 0.182096 Aug 31 05:33:28.500391 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 588/1173] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:33:28 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:33:28.521918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:33:28.522516 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:33:28.529033 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:28.529513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:28.529905 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:28.530599 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:28.531128 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:28.531536 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:28.613700 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-816070cc-6651-4ce3-a1fc-e8f98f806c20 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095716 Aug 31 05:33:28.614339 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 586/1174] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 05:33:28 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:33:29.614053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-26bed4eb-022f-4642-a4d8-e261f9dcc6ea req-fc5e8a20-21e8-47ef-b3e8-e5f688ccb062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1991abd1-003e-4533-b027-b0d3a1cc3ce4", "tag": "3cd54456-cb27-41a8-80f8-a3fb44e52388"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:33:29.624386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-26bed4eb-022f-4642-a4d8-e261f9dcc6ea req-fc5e8a20-21e8-47ef-b3e8-e5f688ccb062 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:33:29.624918 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-26bed4eb-022f-4642-a4d8-e261f9dcc6ea req-fc5e8a20-21e8-47ef-b3e8-e5f688ccb062 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:33:29.625363 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-26bed4eb-022f-4642-a4d8-e261f9dcc6ea req-fc5e8a20-21e8-47ef-b3e8-e5f688ccb062 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:33:29.636527 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-26bed4eb-022f-4642-a4d8-e261f9dcc6ea req-fc5e8a20-21e8-47ef-b3e8-e5f688ccb062 service nova] Creating event network-changed:3cd54456-cb27-41a8-80f8-a3fb44e52388 for instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 on hv-cinder-85220 Aug 31 05:33:29.644609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-26bed4eb-022f-4642-a4d8-e261f9dcc6ea req-fc5e8a20-21e8-47ef-b3e8-e5f688ccb062 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034283 Aug 31 05:33:29.645241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 589/1175] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:34:32.959522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:34:32.960704 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=9 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:34:32.967354 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:32.967829 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:32.974774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:32.975245 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:32.975671 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:32.976327 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:32.976768 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:32.977197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:33.000734 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5e3ccaea-ecb1-4c30-87e7-564eb13d8703 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/ips" status: 200 len: 150 microversion: 2.1 time: 0.044758 Aug 31 05:34:33.001321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 587/1176] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 05:34:32 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:34:34.346038 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=7 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:34:34.346879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=19 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:34:34.351420 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5425f7f-0752-4beb-b11d-6d9c2ace7902"}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:34:34.354168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:34.361006 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:34.361474 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:34.361888 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:34.362585 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:34.363016 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:34.363419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:34.754115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0abf06c4-997e-4263-a8c2-5cf5845bc98b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "POST /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409897 Aug 31 05:34:34.754735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 590/1177] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 05:34:34 2022] POST /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:34:42.463964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:42.464516 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:42.466920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:34:42.467087 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Wed Aug 31 05:34:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments/b5425f7f-0752-4beb-b11d-6d9c2ace7902 (ip 10.222.0.36) !!! Aug 31 05:34:42.473390 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:42.473987 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:42.474485 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:42.475158 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:42.475594 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:42.476007 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:42.613382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lazy-loading 'services' on Instance uuid 1991abd1-003e-4533-b027-b0d3a1cc3ce4 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:34:42.690504 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-283ed4db-465b-4594-98e2-44bec00fe895 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments/b5425f7f-0752-4beb-b11d-6d9c2ace7902" status: 202 len: 0 microversion: 2.1 time: 0.230507 Aug 31 05:34:42.691101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 588/1178] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 05:34:42 2022] DELETE /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments/b5425f7f-0752-4beb-b11d-6d9c2ace7902 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:34:42.700733 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:42.703106 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:42.709735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:42.710226 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:42.710647 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:42.711316 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:42.711739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:42.712147 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:42.741936 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-8e5c4d95-f801-4b74-a3d5-0213339492e1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Aug 31 05:34:42.742532 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 591/1179] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:34:42 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:34:43.760517 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:43.764895 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:43.771830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:43.772300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:43.772721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:43.773394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:43.773836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:43.774278 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:43.804773 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-40b9e82a-3b18-4284-b329-db62694bca73 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052240 Aug 31 05:34:43.805512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 589/1180] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 05:34:43 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 05:34:43.873946 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:43.874993 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:43.884190 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:43.884904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:43.885554 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:43.886669 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:43.887410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:43.888115 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:43.914984 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:34:43.997037 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-917e3d97-fba7-43f6-8cbd-51f4f8ba4b59 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 204 len: 0 microversion: 2.1 time: 0.128501 Aug 31 05:34:43.997700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 592/1181] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:34:43 2022] DELETE /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:34:44.007385 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:44.007987 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:44.014290 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:44.014776 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:44.015238 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:44.015887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:44.016329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:44.016742 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:44.161931 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:34:44.170103 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-29a6393c-7ce9-449b-832e-e66f8b8daff2 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1683 microversion: 2.1 time: 0.166737 Aug 31 05:34:44.170584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 590/1182] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:34:44 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:34:45.195803 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:45.196827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:45.205847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:45.206358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:45.206784 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:45.207465 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:45.207908 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:45.208329 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:45.352728 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:34:45.361328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c9937530-14aa-42a8-a7ff-719423a4e84e tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1683 microversion: 2.1 time: 0.172825 Aug 31 05:34:45.361934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 593/1183] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:34:45 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:34:46.382738 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:46.383320 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:46.389866 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:46.390375 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:46.390805 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:46.391477 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:46.391916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:46.392326 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:46.491038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f728c7e4074084be1a433ae14879b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb164f6efb1d4047b9a5ca77f2ff44a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:34:46.500321 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-cd7d2ab8-6b5e-4d31-8f8a-e22bdc25b1ce tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 200 len: 1615 microversion: 2.1 time: 0.121325 Aug 31 05:34:46.500855 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 591/1184] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:34:46 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 1615 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:34:46.711259 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-504a3194-fc27-4521-a404-1fb57e50c2f3 req-e4a414ab-935f-4eee-9062-77e0c7d6f49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1991abd1-003e-4533-b027-b0d3a1cc3ce4", "name": "network-vif-deleted", "tag": "3cd54456-cb27-41a8-80f8-a3fb44e52388"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:34:46.724461 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-504a3194-fc27-4521-a404-1fb57e50c2f3 req-e4a414ab-935f-4eee-9062-77e0c7d6f49e service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:46.724931 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-504a3194-fc27-4521-a404-1fb57e50c2f3 req-e4a414ab-935f-4eee-9062-77e0c7d6f49e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:46.725350 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-504a3194-fc27-4521-a404-1fb57e50c2f3 req-e4a414ab-935f-4eee-9062-77e0c7d6f49e service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:46.737818 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-504a3194-fc27-4521-a404-1fb57e50c2f3 req-e4a414ab-935f-4eee-9062-77e0c7d6f49e service nova] Creating event network-vif-deleted:3cd54456-cb27-41a8-80f8-a3fb44e52388 for instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 on hv-cinder-85220 Aug 31 05:34:46.743097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-504a3194-fc27-4521-a404-1fb57e50c2f3 req-e4a414ab-935f-4eee-9062-77e0c7d6f49e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036723 Aug 31 05:34:46.746743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 594/1185] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:34:47.521165 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:47.521733 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:47.528721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:47.529210 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:47.529635 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:47.530381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:47.530835 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:47.531243 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:47.546494 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 HTTP/1.1 Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:34:47.548713 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:47.550537 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '1991abd1-003e-4533-b027-b0d3a1cc3ce4'} Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:47.551539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:47.553191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:47.554782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:47.554782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c85ab968-dd5a-4b70-837a-7739791f951b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 404 len: 111 microversion: 2.1 time: 0.033046 Aug 31 05:34:47.554782 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 592/1186] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:34:47 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:34:47.559734 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e70d6f08-a1e2-42c5-983d-c20b39696ac4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '.version_select at 0x7fbd0ea33670>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:47.581161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e70d6f08-a1e2-42c5-983d-c20b39696ac4 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469994130" status: 202 len: 0 microversion: 2.1 time: 0.025525 Aug 31 05:34:47.581840 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 595/1187] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 05:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469994130 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 05:34:49.351083 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:49.351625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:49.358838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:49.359316 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:49.359748 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:49.360432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:49.360872 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:49.361290 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:49.375397 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 HTTP/1.1 Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:34:49.376916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.378637 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '1991abd1-003e-4533-b027-b0d3a1cc3ce4'} Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:49.379576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.381057 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.382557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:49.382557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-262b9627-7b20-481e-bcc8-d40a9c0f1767 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 404 len: 111 microversion: 2.1 time: 0.031140 Aug 31 05:34:49.382557 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 593/1188] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:34:49 2022] DELETE /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:34:49.387457 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:49.388179 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 1991abd1-003e-4533-b027-b0d3a1cc3ce4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:49.397392 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:49.397865 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:49.398328 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:49.399001 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:49.399417 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:49.399830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:49.413054 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 HTTP/1.1 Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:34:49.414695 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.416332 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '1991abd1-003e-4533-b027-b0d3a1cc3ce4'} Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:49.417288 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. Aug 31 05:34:49.418853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:49.420172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance 1991abd1-003e-4533-b027-b0d3a1cc3ce4 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:49.420172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-9fba1e5e-dc24-4bf8-a4b7-4a4d8c433132 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4" status: 404 len: 111 microversion: 2.1 time: 0.033067 Aug 31 05:34:49.420172 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 596/1189] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:34:49 2022] GET /compute/v2.1/servers/1991abd1-003e-4533-b027-b0d3a1cc3ce4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 05:34:50.564997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:50.565513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:50.572342 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:50.572820 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:50.573250 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:50.573923 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:50.574404 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:50.574816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:50.588329 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 HTTP/1.1 Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:34:50.589880 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.591513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': 'e1c5151f-3e47-4ee6-97c2-78b8d8c6a723'} Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:50.592372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.593843 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.595384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:50.595384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0cfc0c6f-eacb-4231-bda0-06a0b303b093 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 404 len: 111 microversion: 2.1 time: 0.030187 Aug 31 05:34:50.595384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 594/1190] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:34:50 2022] DELETE /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:34:50.600878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:50.601475 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: e1c5151f-3e47-4ee6-97c2-78b8d8c6a723] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:50.608337 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:50.608918 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:50.609346 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:50.610033 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:50.610484 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:50.610896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:50.623985 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 HTTP/1.1 Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:34:50.625507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.627123 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'e1c5151f-3e47-4ee6-97c2-78b8d8c6a723'} Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:50.627991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. Aug 31 05:34:50.629488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.630802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:50.630802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a65187cf-5894-4f3e-8850-b9632191bf12 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723" status: 404 len: 111 microversion: 2.1 time: 0.029853 Aug 31 05:34:50.630802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 597/1191] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:34:50 2022] GET /compute/v2.1/servers/e1c5151f-3e47-4ee6-97c2-78b8d8c6a723 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 05:34:50.636104 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:50.636621 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:50.642994 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:50.643468 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:50.644038 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:50.644550 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:50.644989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:50.645390 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:50.661142 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 HTTP/1.1 Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:34:50.662722 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.664357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '6525e687-14ff-454b-8ccc-59b82ab1b8d5'} Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:50.665187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.666489 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.667744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:50.667744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8a21e001-c1d0-43c6-9c2d-44085c2fe8b1 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 404 len: 111 microversion: 2.1 time: 0.031824 Aug 31 05:34:50.667744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 595/1192] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:34:50 2022] DELETE /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:34:50.672735 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:50.673339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: 6525e687-14ff-454b-8ccc-59b82ab1b8d5] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:50.679470 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:50.679938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:50.680365 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:50.681032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:50.681476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:50.681890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:50.695165 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 HTTP/1.1 Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:34:50.696658 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.698236 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '6525e687-14ff-454b-8ccc-59b82ab1b8d5'} Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:50.699140 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. Aug 31 05:34:50.700660 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:50.702028 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance 6525e687-14ff-454b-8ccc-59b82ab1b8d5 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:50.702028 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b0c1fc91-2d2d-4376-aad1-5e41b0167d33 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5" status: 404 len: 111 microversion: 2.1 time: 0.029222 Aug 31 05:34:50.702028 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 598/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:34:50 2022] GET /compute/v2.1/servers/6525e687-14ff-454b-8ccc-59b82ab1b8d5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:34:51.851919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:51.852424 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:51.859732 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:51.860196 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:51.860612 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:51.861300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:51.861730 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:51.862175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:51.876267 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 HTTP/1.1 Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:34:51.877862 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.879528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': 'b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3'} Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:51.880435 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.882061 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.883550 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:51.883550 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1df8b585-e273-4741-8f50-8a0556d7b531 tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 404 len: 111 microversion: 2.1 time: 0.031377 Aug 31 05:34:51.883550 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 596/1194] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:34:51 2022] DELETE /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:34:51.888063 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:34:51.888685 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] [instance: b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:34:51.895192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:51.895662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:51.896080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:51.896792 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:34:51.897232 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:34:51.897703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:34:51.911050 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] HTTP exception thrown: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Request method failure captured: Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 HTTP/1.1 Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvEwOUUAqiX3x8woV-65R4jzAhlKHSPFyaanNMrww4-oaK1a9nAxXP9QKRn_A2OEwThzTmVfLZ66n-euE2JM6J5xICAK3Hx_kw6ULBHKbwEec-mBR7V4jiWMNXIlR637rPEfQaav2Zw_ewnBUIpRolpNYWglARcAIryvf3ZTVklXnO4 Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:34:51.912556 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cb164f6efb1d4047b9a5ca77f2ff44a7", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cb164f6efb1d4047b9a5ca77f2ff44a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: cb164f6efb1d4047b9a5ca77f2ff44a7 Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-134437671 Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: b0f728c7e4074084be1a433ae14879b8 Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-AttachVolumeNegativeTest-134437671-project Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.914180 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3'} Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:34:51.915154 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. Aug 31 05:34:51.916751 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:34:51.918161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] Returning 404 to user: Instance b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:34:51.918161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c0dcdabf-7f83-4f0a-b7fa-76f738d4c89b tempest-AttachVolumeNegativeTest-134437671 tempest-AttachVolumeNegativeTest-134437671-project] 10.222.0.36 "GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3" status: 404 len: 111 microversion: 2.1 time: 0.029744 Aug 31 05:34:51.918161 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 599/1195] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:34:51 2022] GET /compute/v2.1/servers/b0a8f0a6-05bd-48a5-b2bd-11b0c8c428d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:36:11.912809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=20 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:11.913853 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:11.919490 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-689440334", "imageRef": "f9d91818-ef14-453c-be9e-f2c383ee343f", "flavorRef": "452"}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:36:11.974999 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.network.neutron [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] validate_networks() for None {{(pid=120607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:36:12.246357 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Flavor limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:36:12.246762 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Image limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:36:12.247218 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Flavor pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:36:12.247606 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Image pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:36:12.247998 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:36:12.258382 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:12.258874 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:12.259286 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:12.259981 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:12.260418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:12.260823 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:12.278055 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Getting quotas for project 6ee67d32b3cf47f9b77e5a00fcd88188. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:36:12.282046 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Getting quotas for user 5815ac04238a4843860f7a6380887afd and project 6ee67d32b3cf47f9b77e5a00fcd88188. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:36:12.294127 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Going to run 1 instances... {{(pid=120607) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:36:12.296375 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d91818-ef14-453c-be9e-f2c383ee343f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:36:12.351613 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6140bf6c-793b-4324-965b-368833fc8fb2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.441872 Aug 31 05:36:12.352342 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 597/1196] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:36:12.361868 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:12.362757 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:12.366830 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2155fd4b-5dbd-44cd-a918-664eed66b473 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:12.367548 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2155fd4b-5dbd-44cd-a918-664eed66b473 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:12.424948 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2155fd4b-5dbd-44cd-a918-664eed66b473 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:12.432419 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2155fd4b-5dbd-44cd-a918-664eed66b473 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1214 microversion: 2.1 time: 0.072589 Aug 31 05:36:12.432983 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 600/1197] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:12 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:13.459932 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:13.460827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:13.468130 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:13.468628 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:13.469048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:13.469752 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:13.470464 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:13.470872 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:13.533118 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:13.541793 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-60e2f086-1be0-462a-94ef-d155eed63c7f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1266 microversion: 2.1 time: 0.091407 Aug 31 05:36:13.542438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 598/1198] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:13 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:14.563421 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:14.564014 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:14.566842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:36:14.567013 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Wed Aug 31 05:36:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 (ip 10.222.0.36) !!! Aug 31 05:36:14.574655 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:14.575138 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:14.575551 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:14.576233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:14.576678 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:14.577121 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:15.077072 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:15.085187 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3b083e71-3a15-4733-91fb-f367e374621e tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1314 microversion: 2.1 time: 0.525836 Aug 31 05:36:15.085743 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 601/1199] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:14 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:15.561906 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-b484c834-136e-4142-bb92-0c9f5364a09a req-0f75bbec-ff82-4620-b582-b03687436ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "224b2766-5d85-45f3-983a-812c75aec287", "tag": "28d44544-b627-466c-8bb8-3abf21d41363"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:36:15.571371 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b484c834-136e-4142-bb92-0c9f5364a09a req-0f75bbec-ff82-4620-b582-b03687436ffb service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:15.571819 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b484c834-136e-4142-bb92-0c9f5364a09a req-0f75bbec-ff82-4620-b582-b03687436ffb service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:15.572233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b484c834-136e-4142-bb92-0c9f5364a09a req-0f75bbec-ff82-4620-b582-b03687436ffb service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:15.583010 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-b484c834-136e-4142-bb92-0c9f5364a09a req-0f75bbec-ff82-4620-b582-b03687436ffb service nova] Creating event network-changed:28d44544-b627-466c-8bb8-3abf21d41363 for instance 224b2766-5d85-45f3-983a-812c75aec287 on hv-cinder-85220 Aug 31 05:36:15.588127 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-b484c834-136e-4142-bb92-0c9f5364a09a req-0f75bbec-ff82-4620-b582-b03687436ffb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153816 Aug 31 05:36:15.589053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 599/1200] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:36:16.110732 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:16.111635 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:16.121965 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:16.122476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:16.122898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:16.123570 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:16.124012 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:16.124416 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:16.264601 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:16.272939 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6fb880d0-6476-453c-ad25-1eadb6e7c4ac tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1314 microversion: 2.1 time: 0.169186 Aug 31 05:36:16.273516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 602/1201] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:16 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:17.296223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:17.296936 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:17.303356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:17.303833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:17.304255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:17.304928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:17.305368 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:17.305779 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:17.439536 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:17.447406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-f626fb63-9d6b-4b78-861f-5e488d56584a tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1314 microversion: 2.1 time: 0.156935 Aug 31 05:36:17.447985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 600/1202] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:17 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:18.470108 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:18.470961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:18.480264 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:18.480901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:18.481472 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:18.482446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:18.483025 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:18.483592 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:18.622108 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:18.630159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-a1c18cdf-ea64-490c-bc81-ed3b65121e6b tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1314 microversion: 2.1 time: 0.165366 Aug 31 05:36:18.630708 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 603/1203] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:18 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:19.654933 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:19.655919 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:19.666849 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:19.667623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:19.668056 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:19.668730 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:19.669171 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:19.669580 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:19.816798 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:19.829048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-67dfd463-a9cc-4eff-bcab-99e71a046915 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1314 microversion: 2.1 time: 0.180351 Aug 31 05:36:19.829900 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 601/1204] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:19 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:20.394252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-b2bb22bb-3c7c-4a03-8c46-13588eb4527c req-e1f33c40-ca6f-4cbb-8b40-27ae47c342b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b2766-5d85-45f3-983a-812c75aec287", "name": "network-vif-plugged", "status": "completed", "tag": "28d44544-b627-466c-8bb8-3abf21d41363"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:36:20.403915 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-b2bb22bb-3c7c-4a03-8c46-13588eb4527c req-e1f33c40-ca6f-4cbb-8b40-27ae47c342b3 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:20.404378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-b2bb22bb-3c7c-4a03-8c46-13588eb4527c req-e1f33c40-ca6f-4cbb-8b40-27ae47c342b3 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:20.404793 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-b2bb22bb-3c7c-4a03-8c46-13588eb4527c req-e1f33c40-ca6f-4cbb-8b40-27ae47c342b3 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:20.415676 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-b2bb22bb-3c7c-4a03-8c46-13588eb4527c req-e1f33c40-ca6f-4cbb-8b40-27ae47c342b3 service nova] Creating event network-vif-plugged:28d44544-b627-466c-8bb8-3abf21d41363 for instance 224b2766-5d85-45f3-983a-812c75aec287 on hv-cinder-85220 Aug 31 05:36:20.421699 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-b2bb22bb-3c7c-4a03-8c46-13588eb4527c req-e1f33c40-ca6f-4cbb-8b40-27ae47c342b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092014 Aug 31 05:36:20.422271 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 604/1205] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:36:20.858204 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:20.859195 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:20.870830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:20.871593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:20.872213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:20.873137 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:20.873583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:20.873985 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:21.007122 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:21.016429 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c05b65a9-7fb6-45ad-ac59-22b7f7887397 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1314 microversion: 2.1 time: 0.165326 Aug 31 05:36:21.017003 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 602/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:20 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:22.042879 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:22.043677 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:22.051339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:22.051896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:22.052394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:22.053195 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:22.053717 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:22.054234 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:22.190430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:22.198189 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0712017d-4bc2-478f-8f96-dad437f6698c tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1314 microversion: 2.1 time: 0.163009 Aug 31 05:36:22.198745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 605/1207] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:22 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:23.230356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:23.230964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:23.233920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:23.234741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:23.235850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:36:23.236115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Wed Aug 31 05:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 (ip 10.222.0.36) !!! Aug 31 05:36:23.252436 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:23.252921 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:23.253438 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:23.254175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:23.254623 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:23.255037 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:23.395943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:23.407697 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-95ca47ac-3517-41f3-b255-716f8763152f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1464 microversion: 2.1 time: 0.184812 Aug 31 05:36:23.408409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 603/1208] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:23 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:23.452517 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:23.453069 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:23.455132 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:23.461510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:23.461970 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:23.462412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:23.463083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:23.463520 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:23.463981 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:23.493167 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:36:23.574374 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-04b8764a-f4b8-4ea5-9e38-5ff546908e5d tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "DELETE /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 204 len: 0 microversion: 2.1 time: 0.125476 Aug 31 05:36:23.575044 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 606/1209] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:36:23 2022] DELETE /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:36:23.583653 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:23.584285 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:23.590964 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:23.591421 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:23.591848 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:23.592527 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:23.592963 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:23.593384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:23.731356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:23.739653 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-326b6f3d-0a8d-483b-a80e-a7741324eee5 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1470 microversion: 2.1 time: 0.160024 Aug 31 05:36:23.740300 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 604/1210] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:23 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:36:24.766221 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:24.767317 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:24.778507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:24.779287 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:24.780001 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:24.781101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:24.781831 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:24.782560 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:24.935687 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:24.944331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-62f44cab-8523-4bdd-b0a4-17c0840b16f2 tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1470 microversion: 2.1 time: 0.185663 Aug 31 05:36:24.944913 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 607/1211] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:24 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:25.803423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-b9779d96-d5c6-4bde-9b3f-d2faa8c1e1f1 req-0a59c045-f893-4f67-880a-9991b662000a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b2766-5d85-45f3-983a-812c75aec287", "name": "network-vif-deleted", "tag": "28d44544-b627-466c-8bb8-3abf21d41363"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:36:25.813405 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b9779d96-d5c6-4bde-9b3f-d2faa8c1e1f1 req-0a59c045-f893-4f67-880a-9991b662000a service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:25.813852 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b9779d96-d5c6-4bde-9b3f-d2faa8c1e1f1 req-0a59c045-f893-4f67-880a-9991b662000a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:25.814533 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b9779d96-d5c6-4bde-9b3f-d2faa8c1e1f1 req-0a59c045-f893-4f67-880a-9991b662000a service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:25.826699 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-b9779d96-d5c6-4bde-9b3f-d2faa8c1e1f1 req-0a59c045-f893-4f67-880a-9991b662000a service nova] Creating event network-vif-deleted:28d44544-b627-466c-8bb8-3abf21d41363 for instance 224b2766-5d85-45f3-983a-812c75aec287 on hv-cinder-85220 Aug 31 05:36:25.834181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-b9779d96-d5c6-4bde-9b3f-d2faa8c1e1f1 req-0a59c045-f893-4f67-880a-9991b662000a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034395 Aug 31 05:36:25.834813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 605/1212] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:36:25.964917 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:25.965572 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:25.972100 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:25.972578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:25.972994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:25.973704 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:25.974168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:25.974577 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:26.007526 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:26.008005 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:26.008502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:26.008911 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.objects.instance [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lazy-loading 'fault' on Instance uuid 224b2766-5d85-45f3-983a-812c75aec287 {{(pid=120608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:36:26.049542 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5815ac04238a4843860f7a6380887afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee67d32b3cf47f9b77e5a00fcd88188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:36:26.057529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-89926680-1b25-4991-b27c-151e30ca02df tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 200 len: 1304 microversion: 2.1 time: 0.096630 Aug 31 05:36:26.058229 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 608/1213] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:25 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:36:27.084459 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:36:27.085576 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] [instance: 224b2766-5d85-45f3-983a-812c75aec287] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:36:27.096563 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:27.097340 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:27.098074 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:27.099191 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:36:27.099916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:36:27.100595 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:36:27.116302 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] HTTP exception thrown: Instance 224b2766-5d85-45f3-983a-812c75aec287 could not be found. Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Request method failure captured: Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 HTTP/1.1 Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvNKwvYPcY4diEZi3p7I9rBpnzarF1xKQRqV5P6XXv4lq0Y1BlZkQpDCLBece1Tb0RkoKDHtiVSETG9teS_-seUCVzLArL08WvZyWgM53eORrik6cHBHde5HeSothAeWhMOA8RUvO_ZobxQ8KIQ3jBGPaR6p0G4EEmc8ych53dEzcCI Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 6ee67d32b3cf47f9b77e5a00fcd88188 Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-VolumesNegativeTest-941117854 Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:36:27.117896 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ee67d32b3cf47f9b77e5a00fcd88188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6ee67d32b3cf47f9b77e5a00fcd88188", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6ee67d32b3cf47f9b77e5a00fcd88188"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6ee67d32b3cf47f9b77e5a00fcd88188"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-VolumesNegativeTest-941117854 Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 6ee67d32b3cf47f9b77e5a00fcd88188 Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-VolumesNegativeTest-941117854 Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-VolumesNegativeTest-941117854-project Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 5815ac04238a4843860f7a6380887afd Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-VolumesNegativeTest-941117854-project Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 224b2766-5d85-45f3-983a-812c75aec287 could not be found. Aug 31 05:36:27.119741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '224b2766-5d85-45f3-983a-812c75aec287'} Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 224b2766-5d85-45f3-983a-812c75aec287 could not be found. Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:36:27.120845 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 224b2766-5d85-45f3-983a-812c75aec287 could not be found. Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 224b2766-5d85-45f3-983a-812c75aec287 could not be found. Aug 31 05:36:27.122483 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:36:27.124011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] Returning 404 to user: Instance 224b2766-5d85-45f3-983a-812c75aec287 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:36:27.124011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2f8ae694-ac4b-476d-97f6-831fbc02cc6f tempest-VolumesNegativeTest-941117854 tempest-VolumesNegativeTest-941117854-project] 10.222.0.36 "GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287" status: 404 len: 111 microversion: 2.1 time: 0.042578 Aug 31 05:36:27.124011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 606/1214] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:36:27 2022] GET /compute/v2.1/servers/224b2766-5d85-45f3-983a-812c75aec287 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:36:41.315820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:41.316572 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:36:41.505529 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-86b53935-1773-48c7-ac2b-312935ae9792 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Action: 'create', calling method: .version_select at 0x7fbd0eaf5040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-741954775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9UCuFPQQssg2ayAoSSgkkSvUNO0ZkBt6yMEgfhaa410aWWpb/IvOehXtPYRGHxRrShmK8/uezK6ZjiU6iJZIsDnGSAyJUycD1lIWd3vaEZfqGl0P6SVGc0bKYFAsyEkg=="}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:36:41.521816 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-86b53935-1773-48c7-ac2b-312935ae9792 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Getting quotas for project 8c2ff14d7aca45419054434365802dbf. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:36:41.526143 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-86b53935-1773-48c7-ac2b-312935ae9792 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Getting quotas for user 8ae25b465a47404a80b7f40580e70884 and project 8c2ff14d7aca45419054434365802dbf. Resources: {'key_pairs'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:36:41.562645 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-86b53935-1773-48c7-ac2b-312935ae9792 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.251895 Aug 31 05:36:41.563597 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 609/1215] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 05:36:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:37:02.432474 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-400536115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-741954775", "security_groups": [{"name": "tempest-secgroup-smoke-1041731053"}], "block_device_mapping_v2": [{"uuid": "7c8d2c1b-d0ed-472e-b33e-43316144653c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af33da9c-a5e9-4a6b-882c-60cb0966c5b2"}]}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:37:02.443138 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:37:02.443776 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=44 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:37:02.557350 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.network.neutron [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] validate_networks() for [('af33da9c-a5e9-4a6b-882c-60cb0966c5b2', None, None, None, None, None)] {{(pid=120607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:37:03.112197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Flavor limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:37:03.112739 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Image limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:37:03.113403 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Flavor pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:37:03.113939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Image pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:37:03.114487 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:37:03.125881 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:03.126393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:03.126827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:03.127539 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:03.127983 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:03.128439 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:03.145261 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Getting quotas for project 8c2ff14d7aca45419054434365802dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:37:03.149394 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Getting quotas for user 8ae25b465a47404a80b7f40580e70884 and project 8c2ff14d7aca45419054434365802dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:37:03.208593 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Going to run 1 instances... {{(pid=120607) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:37:03.210794 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c8d2c1b-d0ed-472e-b33e-43316144653c',volume_size=None,volume_type=None)] {{(pid=120607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:37:03.358824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-da7d9aaa-da20-4781-a254-7465702a008a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.930250 Aug 31 05:37:03.359476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 607/1216] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:37:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:37:03.370518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3c23c0e8-907a-4de2-a4eb-99901aa01aad tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:03.371113 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3c23c0e8-907a-4de2-a4eb-99901aa01aad tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:03.373540 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=4 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:37:03.374819 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:37:03.428437 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3c23c0e8-907a-4de2-a4eb-99901aa01aad tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:03.436238 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3c23c0e8-907a-4de2-a4eb-99901aa01aad tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1093 microversion: 2.1 time: 0.069671 Aug 31 05:37:03.436991 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 610/1217] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:03 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:04.456716 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:04.457369 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:04.464384 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:04.465721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:04.466186 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:04.467245 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:04.467692 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:04.468101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:04.540967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:04.552450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-01ae18a2-35de-4186-a767-b0d70fb0bcaf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1199 microversion: 2.1 time: 0.100136 Aug 31 05:37:04.553361 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 608/1218] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:04 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:05.573303 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:05.573929 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:05.581097 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:05.581608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:05.582035 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:05.582745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:05.583227 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:05.583639 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:05.817163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:05.825624 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-46fbd311-0f90-4b4b-af61-ed8a3cd2452e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.256519 Aug 31 05:37:05.826416 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 611/1219] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:05 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:05.929689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-b6ea8696-5c23-499a-99cd-3c0a65b06649 req-6f798c42-771b-4f2d-869d-b3d1f780101c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800cf21c-8f74-445b-952b-ec8cca4a4858", "tag": "4173103d-b3f5-4ad0-b6df-04905e163060"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:37:05.940774 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b6ea8696-5c23-499a-99cd-3c0a65b06649 req-6f798c42-771b-4f2d-869d-b3d1f780101c service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:05.941356 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b6ea8696-5c23-499a-99cd-3c0a65b06649 req-6f798c42-771b-4f2d-869d-b3d1f780101c service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:05.941952 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-b6ea8696-5c23-499a-99cd-3c0a65b06649 req-6f798c42-771b-4f2d-869d-b3d1f780101c service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:05.954296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-b6ea8696-5c23-499a-99cd-3c0a65b06649 req-6f798c42-771b-4f2d-869d-b3d1f780101c service nova] Creating event network-changed:4173103d-b3f5-4ad0-b6df-04905e163060 for instance 800cf21c-8f74-445b-952b-ec8cca4a4858 on hv-cinder-85220 Aug 31 05:37:05.959372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-b6ea8696-5c23-499a-99cd-3c0a65b06649 req-6f798c42-771b-4f2d-869d-b3d1f780101c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034939 Aug 31 05:37:05.960048 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 609/1220] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:37:06.849961 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:06.850975 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:06.862243 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:06.863032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:06.863738 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:06.864848 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:06.865579 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:06.866327 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:07.014440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:07.022260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-06a45df9-018f-412b-9c01-8a04afaf0580 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.178842 Aug 31 05:37:07.022842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 612/1221] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:06 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:08.048554 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:08.049683 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:08.060211 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:08.060996 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:08.061701 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:08.062853 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:08.063605 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:08.064294 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:08.211738 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:08.220687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b0dc7cd3-5cac-4f8d-9f4e-e978055829ac tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.179660 Aug 31 05:37:08.221283 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 610/1222] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:08 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:09.252412 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:09.253338 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:09.264023 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:09.264799 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:09.265494 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:09.266662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:09.267394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:09.268138 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:09.422244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:09.430530 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-439c36d0-7607-4c98-a005-806dbb502679 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.184708 Aug 31 05:37:09.431094 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 613/1223] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:09 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:10.455743 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:10.456720 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:10.466175 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:10.466660 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:10.467093 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:10.467777 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:10.468220 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:10.468641 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:10.609879 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:10.618428 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5a5b183f-08a1-414e-aea2-30e9de6e50bf tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.169307 Aug 31 05:37:10.619005 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 611/1224] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:10 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:11.640989 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:11.641718 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:11.648446 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:11.648928 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:11.649355 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:11.650041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:11.650516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:11.650937 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:11.786670 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:11.796488 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-668a4edd-7e77-4339-94c6-af95204b2c28 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.159530 Aug 31 05:37:11.797071 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 614/1225] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:11 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:12.820349 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:12.821309 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:12.832631 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:12.833426 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:12.834309 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:12.835455 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:12.836372 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:12.837598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:12.976772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:12.985077 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-c0066389-9879-4d9a-8a6d-9a7ab767550b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.171252 Aug 31 05:37:12.985636 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 612/1226] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:12 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:14.010479 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:14.011430 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:14.014453 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:37:14.020225 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:14.020703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:14.021129 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:14.021807 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:14.022281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:14.022724 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:14.158300 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:14.166772 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-f2faee97-16f9-4fde-8df7-aca23adf4498 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.162896 Aug 31 05:37:14.167369 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 615/1227] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:14 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:15.187292 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:15.187671 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:15.189538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:37:15.190255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:37:15.197187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:15.197689 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:15.198381 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:15.198838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:15.199319 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:15.199736 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:15.334074 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:15.345601 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-800180f4-5dba-42b5-9c60-0f21b74195e0 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.162579 Aug 31 05:37:15.346434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 613/1228] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:15 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:16.374334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:16.375267 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:16.387212 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:16.388496 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:16.388737 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:16.389415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:16.389917 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:16.390339 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:16.531620 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:16.539962 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3d97fbcd-09c7-41f6-a644-1f8b61cc6b92 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.172101 Aug 31 05:37:16.540550 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 616/1229] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:16 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:16.581441 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-c08609e6-f4cc-480a-aa1d-4122c21cf48b req-16528d9f-42f6-47bd-bc09-aaf51c23b1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800cf21c-8f74-445b-952b-ec8cca4a4858", "name": "network-vif-plugged", "status": "completed", "tag": "4173103d-b3f5-4ad0-b6df-04905e163060"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:37:16.591587 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c08609e6-f4cc-480a-aa1d-4122c21cf48b req-16528d9f-42f6-47bd-bc09-aaf51c23b1f4 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:16.592111 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c08609e6-f4cc-480a-aa1d-4122c21cf48b req-16528d9f-42f6-47bd-bc09-aaf51c23b1f4 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:16.592532 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-c08609e6-f4cc-480a-aa1d-4122c21cf48b req-16528d9f-42f6-47bd-bc09-aaf51c23b1f4 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:16.604536 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-c08609e6-f4cc-480a-aa1d-4122c21cf48b req-16528d9f-42f6-47bd-bc09-aaf51c23b1f4 service nova] Creating event network-vif-plugged:4173103d-b3f5-4ad0-b6df-04905e163060 for instance 800cf21c-8f74-445b-952b-ec8cca4a4858 on hv-cinder-85220 Aug 31 05:37:16.609881 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-c08609e6-f4cc-480a-aa1d-4122c21cf48b req-16528d9f-42f6-47bd-bc09-aaf51c23b1f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032186 Aug 31 05:37:16.610530 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 614/1230] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:37:17.561007 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:17.561641 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:17.568811 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:17.569282 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:17.569703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:17.570413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:17.570853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:17.571265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:17.712340 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:17.720578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ed668d3f-ef31-42da-97a9-18589788c2a6 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1265 microversion: 2.1 time: 0.163541 Aug 31 05:37:17.721129 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 617/1231] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:17 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:18.743140 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:18.743793 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:18.751174 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:18.751652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:18.752071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:18.752746 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:18.753181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:18.753584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:18.890270 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:18.904558 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6ad69455-110c-4b58-9072-6fa68569a5e3 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1452 microversion: 2.1 time: 0.165545 Aug 31 05:37:18.905534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 615/1232] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:18 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:18.928815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:37:18.929381 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:37:18.938479 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:18.939181 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:18.939797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:18.940518 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:18.941157 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:18.941781 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:19.075032 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:37:19.082987 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-cb8a1d69-4cda-44c0-9cbc-3fe323841511 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1452 microversion: 2.1 time: 0.161410 Aug 31 05:37:19.083558 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 618/1233] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:37:18 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:37:21.052275 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-a4f6b474-716e-4f24-93c5-84ab85878d30 req-5bb08498-1d06-4dbd-91ef-ae8c17b90833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800cf21c-8f74-445b-952b-ec8cca4a4858", "tag": "4173103d-b3f5-4ad0-b6df-04905e163060"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:37:21.062155 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a4f6b474-716e-4f24-93c5-84ab85878d30 req-5bb08498-1d06-4dbd-91ef-ae8c17b90833 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:37:21.062627 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a4f6b474-716e-4f24-93c5-84ab85878d30 req-5bb08498-1d06-4dbd-91ef-ae8c17b90833 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:37:21.063043 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-a4f6b474-716e-4f24-93c5-84ab85878d30 req-5bb08498-1d06-4dbd-91ef-ae8c17b90833 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:37:21.074331 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-a4f6b474-716e-4f24-93c5-84ab85878d30 req-5bb08498-1d06-4dbd-91ef-ae8c17b90833 service nova] Creating event network-changed:4173103d-b3f5-4ad0-b6df-04905e163060 for instance 800cf21c-8f74-445b-952b-ec8cca4a4858 on hv-cinder-85220 Aug 31 05:37:21.079350 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-a4f6b474-716e-4f24-93c5-84ab85878d30 req-5bb08498-1d06-4dbd-91ef-ae8c17b90833 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030760 Aug 31 05:37:21.080189 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 616/1234] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:39:34.828820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=20 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:39:34.829741 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=48 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:39:34.831711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 05:39:34.831927 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Wed Aug 31 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 (ip 10.222.0.36) !!! Aug 31 05:39:34.833442 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 05:39:34.833652 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Wed Aug 31 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 (ip 10.222.0.36) !!! Aug 31 05:39:34.835146 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 05:39:34.835337 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Wed Aug 31 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 (ip 10.222.0.36) !!! Aug 31 05:39:34.840746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:34.841343 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:34.857309 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:34.857791 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:34.858251 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:34.858949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:34.859395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:34.859815 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:34.886649 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Going to try to terminate instance {{(pid=120608) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:39:34.975463 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3c7342b0-0291-4f94-a488-8fe9c6b2ffb7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "DELETE /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 204 len: 0 microversion: 2.1 time: 0.148706 Aug 31 05:39:34.976197 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 619/1235] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:39:34 2022] DELETE /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:39:34.983970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f43e2586-d278-4c96-af6d-22ea8a6235b6] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 05:39:34.985187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:39:34.986062 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=44 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:39:34.987760 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 05:39:34.987901 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Wed Aug 31 05:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 (ip 10.222.0.36) !!! Aug 31 05:39:34.993794 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:34.994513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:35.003313 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:35.003783 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:35.004213 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:35.004888 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:35.005332 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:35.005744 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:35.156480 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:35.164879 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-60abb8f4-530f-49d8-ad6d-74503d22e5fb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1576 microversion: 2.1 time: 0.183272 Aug 31 05:39:35.165547 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 617/1236] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:34 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:36.189111 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:36.190510 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:36.201901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:36.202710 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:36.203380 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:36.204495 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:36.205235 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:36.205934 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:36.444729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:36.453438 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-da3c47a9-1229-44eb-b9a6-c930e27f1084 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1576 microversion: 2.1 time: 0.270501 Aug 31 05:39:36.454185 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 620/1237] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:36 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1576 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:37.475939 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:37.476564 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:37.484409 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:37.484887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:37.485947 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:37.486318 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:37.486423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:37.486857 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:37.499207 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] [f43e2586-d278-4c96-af6d-22ea8a6235b6] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48188. Aug 31 05:39:37.567110 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:37.575053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-57581e28-e410-49f2-9445-97eb26c62d44 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1508 microversion: 2.1 time: 0.103217 Aug 31 05:39:37.575639 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 618/1238] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:37 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1508 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:37.795587 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-64b2592a-23bd-463a-86b9-c4c4d4f73088 req-d721dae9-fda3-4327-a8c8-c73cbc60a448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800cf21c-8f74-445b-952b-ec8cca4a4858", "name": "network-vif-deleted", "tag": "4173103d-b3f5-4ad0-b6df-04905e163060"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:39:37.806440 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-64b2592a-23bd-463a-86b9-c4c4d4f73088 req-d721dae9-fda3-4327-a8c8-c73cbc60a448 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:37.806931 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-64b2592a-23bd-463a-86b9-c4c4d4f73088 req-d721dae9-fda3-4327-a8c8-c73cbc60a448 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:37.807367 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-64b2592a-23bd-463a-86b9-c4c4d4f73088 req-d721dae9-fda3-4327-a8c8-c73cbc60a448 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:37.821648 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-64b2592a-23bd-463a-86b9-c4c4d4f73088 req-d721dae9-fda3-4327-a8c8-c73cbc60a448 service nova] Creating event network-vif-deleted:4173103d-b3f5-4ad0-b6df-04905e163060 for instance 800cf21c-8f74-445b-952b-ec8cca4a4858 on hv-cinder-85220 Aug 31 05:39:37.832153 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-64b2592a-23bd-463a-86b9-c4c4d4f73088 req-d721dae9-fda3-4327-a8c8-c73cbc60a448 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040026 Aug 31 05:39:37.833159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 621/1239] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:39:38.595836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:38.596466 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:38.603714 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:38.604196 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:38.604617 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:38.605657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:38.606181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:38.606616 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:38.643199 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:38.643804 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:38.644225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:38.644970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.objects.instance [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lazy-loading 'fault' on Instance uuid 800cf21c-8f74-445b-952b-ec8cca4a4858 {{(pid=120607) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 05:39:38.686552 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:38.695869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0daef3ea-16de-4b46-8e61-dbb19aa02081 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 200 len: 1229 microversion: 2.1 time: 0.104012 Aug 31 05:39:38.696528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 619/1240] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:38 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:39.718485 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:39.719427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:39.727811 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:39.728441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:39.729006 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:39.730296 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:39.730891 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:39.731441 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:39.748098 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] HTTP exception thrown: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Request method failure captured: Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 HTTP/1.1 Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvNkt80UL5OnqqG_bN196PHffypnbP55ZvoGoTjkamsLE_cIhK7MuezodAGJyTTn-MTWvhWUaxTMEAawuJR15k7pEdZuaS_ZYiywk___iuxFFYKLnaYdPis4u9Z_6IEzjDPsyQB8X0P5Z4sk1X7qbUOtdi8d_ty9ysgfbahMiwupqPA Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:39:39.749697 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c2ff14d7aca45419054434365802dbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestVolumeBootPattern-411905407 Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 8ae25b465a47404a80b7f40580e70884 Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:39:39.751464 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '800cf21c-8f74-445b-952b-ec8cca4a4858'} Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:39:39.752628 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:39:39.754334 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:39:39.755847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Returning 404 to user: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:39:39.755847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-1756ed81-870b-4024-a435-80d0bcb73973 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 404 len: 111 microversion: 2.1 time: 0.038684 Aug 31 05:39:39.755847 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 622/1241] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:39 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:39:39.798772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-351131324", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-741954775", "security_groups": [{"name": "tempest-secgroup-smoke-1041731053"}], "block_device_mapping_v2": [{"uuid": "7c8d2c1b-d0ed-472e-b33e-43316144653c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af33da9c-a5e9-4a6b-882c-60cb0966c5b2"}]}} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:39:39.916624 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.network.neutron [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] validate_networks() for [('af33da9c-a5e9-4a6b-882c-60cb0966c5b2', None, None, None, None, None)] {{(pid=120607) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:39:40.293949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Flavor limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:39:40.294665 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Image limits 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:39:40.295425 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Flavor pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:39:40.296078 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Image pref 0:0:0 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:39:40.296727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.virt.hardware [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120607) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:39:40.311460 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:40.312223 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:40.312918 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:40.314102 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:40.314838 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:40.315512 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:40.335676 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Getting quotas for project 8c2ff14d7aca45419054434365802dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:39:40.339999 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.quota [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Getting quotas for user 8ae25b465a47404a80b7f40580e70884 and project 8c2ff14d7aca45419054434365802dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=120607) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:39:40.400009 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Going to run 1 instances... {{(pid=120607) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:39:40.402222 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c8d2c1b-d0ed-472e-b33e-43316144653c',volume_size=None,volume_type=None)] {{(pid=120607) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:39:40.532198 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-0d008d68-0bee-4c01-8c42-5bee8e45d76a tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737295 Aug 31 05:39:40.532858 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 620/1242] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:39:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:39:40.543875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b7741f24-b0fa-46b5-b48b-5c6f3ca36868 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:40.544611 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b7741f24-b0fa-46b5-b48b-5c6f3ca36868 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:40.599082 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-b7741f24-b0fa-46b5-b48b-5c6f3ca36868 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:40.607345 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b7741f24-b0fa-46b5-b48b-5c6f3ca36868 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1093 microversion: 2.1 time: 0.067547 Aug 31 05:39:40.607901 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 623/1243] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:40 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:41.628117 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:41.628720 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:41.635892 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:41.636328 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:41.636967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:41.637772 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:41.638418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:41.642528 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:41.978402 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:41.988295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-2a97090c-ed33-416d-8005-49eb6962f310 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1199 microversion: 2.1 time: 0.364554 Aug 31 05:39:41.988869 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 621/1244] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:41 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1199 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:43.012386 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:43.013051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:43.020681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:43.021294 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:43.021813 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:43.022633 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:43.023083 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:43.023533 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:43.241903 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:43.249949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-0255978b-5b77-4332-aeb2-ee45c77bc1ca tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.241762 Aug 31 05:39:43.250547 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 624/1245] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:43 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:43.342237 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-017a320d-5371-4b6b-bed9-4ef36d7a02d3 req-76d61f56-6e40-473d-b549-8da81186c9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5f6015-2e91-4eab-bbcd-6925749d4b71", "tag": "46732fec-2f32-4067-933b-e6d48b32064f"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:39:43.353513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-017a320d-5371-4b6b-bed9-4ef36d7a02d3 req-76d61f56-6e40-473d-b549-8da81186c9fb service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:43.354125 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-017a320d-5371-4b6b-bed9-4ef36d7a02d3 req-76d61f56-6e40-473d-b549-8da81186c9fb service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:43.355181 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-017a320d-5371-4b6b-bed9-4ef36d7a02d3 req-76d61f56-6e40-473d-b549-8da81186c9fb service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:43.366667 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-017a320d-5371-4b6b-bed9-4ef36d7a02d3 req-76d61f56-6e40-473d-b549-8da81186c9fb service nova] Creating event network-changed:46732fec-2f32-4067-933b-e6d48b32064f for instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 on hv-cinder-85220 Aug 31 05:39:43.369970 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR oslo.messaging._drivers.impl_rabbit [req-017a320d-5371-4b6b-bed9-4ef36d7a02d3 req-76d61f56-6e40-473d-b549-8da81186c9fb service nova] [4d2928d2-7960-4862-9cc5-219188a11db1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 05:39:44.276414 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:44.277363 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:44.284745 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:44.285242 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:44.285687 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:44.286469 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:44.286938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:44.287375 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:44.377887 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [req-017a320d-5371-4b6b-bed9-4ef36d7a02d3 req-76d61f56-6e40-473d-b549-8da81186c9fb service nova] [4d2928d2-7960-4862-9cc5-219188a11db1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48230. Aug 31 05:39:44.381531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-017a320d-5371-4b6b-bed9-4ef36d7a02d3 req-76d61f56-6e40-473d-b549-8da81186c9fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.043544 Aug 31 05:39:44.382197 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 622/1246] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:39:44.425344 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:44.436459 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-45223fde-9acc-49ba-8baf-8049b60c5bdb tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.166593 Aug 31 05:39:44.437002 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 625/1247] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:44 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:45.462834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:45.463976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:45.475124 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:45.475911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:45.476625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:45.477754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:45.478544 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:45.479249 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:45.681911 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:45.689954 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-39821e28-63b2-4b36-9b8d-28a3d31ab259 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.234963 Aug 31 05:39:45.690579 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 623/1248] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:45 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:46.714705 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:46.715636 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:46.726729 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:46.727507 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:46.728210 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:46.729324 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:46.730493 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:46.731190 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:46.866202 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:46.878378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e6c37dd2-2723-48f9-b622-b5e02dfc0db8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.169952 Aug 31 05:39:46.879138 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 626/1249] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:46 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:47.906812 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:47.907569 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:47.916465 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:47.917105 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:47.917709 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:47.918673 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:47.919265 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:47.919824 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:48.069472 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:48.082212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-6ca2dd65-4166-444b-8af9-06ccdea9b31e tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.181433 Aug 31 05:39:48.083071 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 624/1250] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:47 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:49.110196 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:49.110896 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:49.118842 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:49.119403 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:49.119946 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:49.120750 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:49.121278 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:49.121769 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:49.262159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:49.270308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-d8a90318-4023-4539-bb0e-2fffa525eb0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.166329 Aug 31 05:39:49.270883 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 627/1251] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:49 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:50.297785 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:50.298761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:50.309657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:50.310648 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:50.311078 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:50.311752 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:50.312187 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:50.312596 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:50.328040 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:39:50.346842 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=6 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:39:50.445522 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:50.453920 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-7117e0bc-9040-40fa-8616-ec7ab1202506 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.162780 Aug 31 05:39:50.454530 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 625/1252] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:50 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:51.476427 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:51.477051 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:51.479499 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:39:51.485399 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:51.485863 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:51.486308 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:51.486981 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:51.487415 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:51.487824 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:51.622800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:51.630651 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-3d512ae1-8670-4638-af2b-2bd39bfe0f02 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.158097 Aug 31 05:39:51.631215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 628/1253] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:51 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:52.655218 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:52.656170 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:52.667193 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:52.667977 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:52.668687 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:52.669801 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:52.670591 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:52.671434 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:52.810810 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:52.823049 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-1b29cb79-5f2f-4c32-9fb6-81fabf417ef2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.174210 Aug 31 05:39:52.823865 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 626/1254] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:52 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:53.342033 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-20b2382d-82aa-4990-bbfa-0c840441cf68 req-c6f46f20-7682-4352-a20c-df0767724bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5f6015-2e91-4eab-bbcd-6925749d4b71", "name": "network-vif-plugged", "status": "completed", "tag": "46732fec-2f32-4067-933b-e6d48b32064f"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:39:53.352552 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-20b2382d-82aa-4990-bbfa-0c840441cf68 req-c6f46f20-7682-4352-a20c-df0767724bef service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:53.352908 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-20b2382d-82aa-4990-bbfa-0c840441cf68 req-c6f46f20-7682-4352-a20c-df0767724bef service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:53.353358 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-20b2382d-82aa-4990-bbfa-0c840441cf68 req-c6f46f20-7682-4352-a20c-df0767724bef service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:53.364706 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-20b2382d-82aa-4990-bbfa-0c840441cf68 req-c6f46f20-7682-4352-a20c-df0767724bef service nova] Creating event network-vif-plugged:46732fec-2f32-4067-933b-e6d48b32064f for instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 on hv-cinder-85220 Aug 31 05:39:53.369781 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-20b2382d-82aa-4990-bbfa-0c840441cf68 req-c6f46f20-7682-4352-a20c-df0767724bef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031624 Aug 31 05:39:53.370346 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 629/1255] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:39:53.847239 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:53.847943 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:53.856252 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:53.856800 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:53.857299 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:53.858103 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:53.858617 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:53.859127 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:53.995533 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:54.004344 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e501898b-509f-4c87-8e66-538bc03e7522 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.162824 Aug 31 05:39:54.004940 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 627/1256] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:53 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:55.030256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:55.031382 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:55.041781 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:55.042671 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:55.043341 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:55.044481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:55.045207 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:55.045899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:55.189931 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:55.197959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ea488c06-99a4-4306-a7d7-2617426f96d8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1265 microversion: 2.1 time: 0.175746 Aug 31 05:39:55.198568 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 630/1257] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:55 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:56.219045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:56.219650 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:56.226817 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:56.227338 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:56.227761 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:56.228431 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:56.228847 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:56.229297 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:56.369685 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:56.377921 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-61cb1406-4336-41c7-b475-2099ca7f6cf8 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1452 microversion: 2.1 time: 0.162794 Aug 31 05:39:56.378561 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 628/1258] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:56 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:39:56.403149 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:39:56.403711 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:39:56.410693 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:56.411168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:56.411588 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:56.412263 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:56.412703 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:56.413114 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:56.546315 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:39:56.554325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-02fb33d1-ebc9-4923-89b5-7641c2d1d9c4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1452 microversion: 2.1 time: 0.155018 Aug 31 05:39:56.554898 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 631/1259] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:39:56 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:39:58.441787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [req-839323c7-78c9-4000-890c-ba075fb97864 req-2c2c6c1b-3666-47ee-9c44-ef21cb23eee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5f6015-2e91-4eab-bbcd-6925749d4b71", "tag": "46732fec-2f32-4067-933b-e6d48b32064f"}]} {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:39:58.451652 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-839323c7-78c9-4000-890c-ba075fb97864 req-2c2c6c1b-3666-47ee-9c44-ef21cb23eee9 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:39:58.452123 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-839323c7-78c9-4000-890c-ba075fb97864 req-2c2c6c1b-3666-47ee-9c44-ef21cb23eee9 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:39:58.452542 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [req-839323c7-78c9-4000-890c-ba075fb97864 req-2c2c6c1b-3666-47ee-9c44-ef21cb23eee9 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:39:58.463566 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.compute.server_external_events [req-839323c7-78c9-4000-890c-ba075fb97864 req-2c2c6c1b-3666-47ee-9c44-ef21cb23eee9 service nova] Creating event network-changed:46732fec-2f32-4067-933b-e6d48b32064f for instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 on hv-cinder-85220 Aug 31 05:39:58.468833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [req-839323c7-78c9-4000-890c-ba075fb97864 req-2c2c6c1b-3666-47ee-9c44-ef21cb23eee9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030780 Aug 31 05:39:58.469536 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 629/1260] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:42:11.959959 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2312fd2a-b124-4b05-a47e-cf828e551399] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 05:42:11.960773 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:42:11.961517 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:42:11.966787 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1273670141", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-741954775", "security_groups": [{"name": "tempest-secgroup-smoke-1041731053"}], "block_device_mapping_v2": [{"uuid": "875a6f28-4a05-48a6-ad81-6dad6105793f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "af33da9c-a5e9-4a6b-882c-60cb0966c5b2"}]}} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:42:12.096067 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.network.neutron [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] validate_networks() for [('af33da9c-a5e9-4a6b-882c-60cb0966c5b2', None, None, None, None, None)] {{(pid=120608) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 05:42:12.529438 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Flavor limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 05:42:12.530159 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Image limits 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 05:42:12.530746 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Flavor pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 05:42:12.531316 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Image pref 0:0:0 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 05:42:12.531899 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.virt.hardware [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 05:42:12.542783 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:12.543277 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:12.543682 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:12.544395 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:12.544838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:12.545252 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:12.562502 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Getting quotas for project 8c2ff14d7aca45419054434365802dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 05:42:12.568057 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.quota [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Getting quotas for user 8ae25b465a47404a80b7f40580e70884 and project 8c2ff14d7aca45419054434365802dbf. Resources: {'instances', 'ram', 'cores'} {{(pid=120608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 05:42:12.635095 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Going to run 1 instances... {{(pid=120608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 05:42:12.637214 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='875a6f28-4a05-48a6-ad81-6dad6105793f',volume_size=None,volume_type=None)] {{(pid=120608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 05:42:12.771663 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fea38e65-4dba-450a-803c-43584786d66d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813587 Aug 31 05:42:12.772331 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 632/1261] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 05:42:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 05:42:12.789022 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f43e2586-d278-4c96-af6d-22ea8a6235b6] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 05:42:12.790274 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:42:12.791074 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=68 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:42:12.792371 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 05:42:12.792583 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Wed Aug 31 05:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 (ip 10.222.0.36) !!! Aug 31 05:42:12.798912 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-36a65657-ef97-4f06-a9e5-d0475b907bad tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:12.799598 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-36a65657-ef97-4f06-a9e5-d0475b907bad tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:12.856101 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-36a65657-ef97-4f06-a9e5-d0475b907bad tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:12.863311 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-36a65657-ef97-4f06-a9e5-d0475b907bad tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1094 microversion: 2.1 time: 0.076372 Aug 31 05:42:12.863876 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 630/1262] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:12 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:13.889222 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:13.893641 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:13.905739 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:13.906265 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:13.906818 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:13.907498 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:13.907938 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:13.908348 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:13.908965 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] [2312fd2a-b124-4b05-a47e-cf828e551399] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48390. Aug 31 05:42:13.990195 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:13.999853 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-c3c88950-0a7c-4d44-a738-3726e41652df tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1192 microversion: 2.1 time: 0.117307 Aug 31 05:42:14.000431 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 633/1263] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:13 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1192 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:15.021322 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:15.021955 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:15.031878 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] [f43e2586-d278-4c96-af6d-22ea8a6235b6] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48394. Aug 31 05:42:15.038611 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:15.039102 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:15.039538 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:15.040229 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:15.040681 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:15.041098 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:15.233666 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:15.243959 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-5ec7208e-2d72-4f72-8d3b-f6c0eeba4bed tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.226621 Aug 31 05:42:15.244754 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 631/1264] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:15 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:15.548667 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-aec2a88b-d463-4ad9-84a8-2811f6264734 req-d7e53806-be94-49ac-b6b4-d9a7d78229eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ee8173-a9aa-4d78-9181-d0156a3bbad4", "tag": "f8da5ab4-3d91-4b9b-b05c-5b2291e81d28"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:42:15.558281 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-aec2a88b-d463-4ad9-84a8-2811f6264734 req-d7e53806-be94-49ac-b6b4-d9a7d78229eb service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:15.558749 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-aec2a88b-d463-4ad9-84a8-2811f6264734 req-d7e53806-be94-49ac-b6b4-d9a7d78229eb service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:15.559163 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-aec2a88b-d463-4ad9-84a8-2811f6264734 req-d7e53806-be94-49ac-b6b4-d9a7d78229eb service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:15.570254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-aec2a88b-d463-4ad9-84a8-2811f6264734 req-d7e53806-be94-49ac-b6b4-d9a7d78229eb service nova] Creating event network-changed:f8da5ab4-3d91-4b9b-b05c-5b2291e81d28 for instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 on hv-cinder-85220 Aug 31 05:42:15.575450 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-aec2a88b-d463-4ad9-84a8-2811f6264734 req-d7e53806-be94-49ac-b6b4-d9a7d78229eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091036 Aug 31 05:42:15.576103 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 634/1265] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:42:16.269180 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:16.270166 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:16.281129 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:16.281928 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:16.282827 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:16.283619 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:16.284212 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:16.284787 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:16.419201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:16.427114 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-8d491079-96c3-491b-adb5-b6c49f067400 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.164503 Aug 31 05:42:16.427698 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 632/1266] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:16 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:17.455681 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:17.456323 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:17.467168 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:17.467807 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:17.468282 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:17.469080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:17.469552 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:17.470018 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:17.615109 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:17.623504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-ee2c234d-b40a-4d23-b7cc-8675944658a2 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.175915 Aug 31 05:42:17.624078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 635/1267] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:17 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:18.649054 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:18.649728 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:18.659229 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:18.659711 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:18.660112 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:18.660816 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:18.661258 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:18.661665 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:18.802531 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:18.810667 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-4affb279-c53f-41ea-8613-c5e3da706c10 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.168962 Aug 31 05:42:18.811248 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 633/1268] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:18 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:19.835351 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:19.836325 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:19.847285 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:19.848071 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:19.848766 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:19.849894 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:19.850689 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:19.851374 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:19.994480 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:20.002860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-e8d9f6ff-267a-4aa6-bc18-51f9f4aa7e5d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.174207 Aug 31 05:42:20.003471 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 636/1269] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:19 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:21.027663 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:21.028659 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:21.037441 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:21.037914 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:21.038339 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:21.039039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:21.039476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:21.039883 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:21.177011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:21.184850 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-920a88d1-715d-4bfe-bc6a-c53e47ae3631 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.163795 Aug 31 05:42:21.185423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 634/1270] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:21 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:22.207135 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:22.207742 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:22.214388 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:22.214867 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:22.215291 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:22.215994 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:22.216413 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:22.216827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:22.348802 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:22.357609 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-2a863b93-ebdd-476b-a004-e22e671c4bb4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.156156 Aug 31 05:42:22.358279 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 637/1271] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:22 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:23.382902 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:23.383865 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:23.387836 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell0:SELECT=2 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:42:23.395584 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:23.396053 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:23.396488 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:23.397157 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:23.397592 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:23.397997 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:23.536638 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:23.548182 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-defb1d1d-827c-47f9-b571-5d3dfa1bd220 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.171585 Aug 31 05:42:23.548960 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 635/1272] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:23 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:24.573019 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:24.573940 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:24.577128 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=2 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:42:24.578293 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell0:SELECT=6 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:42:24.588398 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:24.589182 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:24.589889 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:24.591041 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:24.591777 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:24.592476 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:24.731489 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:24.739508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-7cb768f2-3e28-4f0b-a18c-e57d3074cf11 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.173053 Aug 31 05:42:24.740192 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 638/1273] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:24 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 05:42:25.764264 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:25.765500 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:25.773461 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:25.773929 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:25.774393 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:25.775084 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:25.775558 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:25.775975 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:25.915976 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:25.923830 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ba56b959-dac5-4907-852d-1ed5a1b8c9b4 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.166111 Aug 31 05:42:25.924450 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 636/1274] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:25 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:26.083254 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-3abce293-165d-4f16-a980-8c50039ab744 req-763d5330-24bd-48ac-888e-4d7f3146c39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ee8173-a9aa-4d78-9181-d0156a3bbad4", "name": "network-vif-plugged", "status": "completed", "tag": "f8da5ab4-3d91-4b9b-b05c-5b2291e81d28"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:42:26.093297 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3abce293-165d-4f16-a980-8c50039ab744 req-763d5330-24bd-48ac-888e-4d7f3146c39b service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:26.093770 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3abce293-165d-4f16-a980-8c50039ab744 req-763d5330-24bd-48ac-888e-4d7f3146c39b service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:26.094241 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-3abce293-165d-4f16-a980-8c50039ab744 req-763d5330-24bd-48ac-888e-4d7f3146c39b service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:26.106838 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-3abce293-165d-4f16-a980-8c50039ab744 req-763d5330-24bd-48ac-888e-4d7f3146c39b service nova] Creating event network-vif-plugged:f8da5ab4-3d91-4b9b-b05c-5b2291e81d28 for instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 on hv-cinder-85220 Aug 31 05:42:26.111921 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-3abce293-165d-4f16-a980-8c50039ab744 req-763d5330-24bd-48ac-888e-4d7f3146c39b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086614 Aug 31 05:42:26.112416 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 639/1275] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:42:26.947084 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:26.947916 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:26.957844 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:26.958628 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:26.959285 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:26.960310 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:26.960989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:26.961619 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:27.108577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:27.116560 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-afb32c71-6332-409f-a274-c3a0b0a80c47 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1266 microversion: 2.1 time: 0.175676 Aug 31 05:42:27.117133 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 637/1276] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:26 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:28.143055 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:28.143744 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:28.150845 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:28.151347 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:28.151797 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:28.152494 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:28.152976 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:28.153409 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:28.295977 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:28.308700 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-fc1b480d-1f4c-4eb2-a4f2-8cebbcd8763d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1454 microversion: 2.1 time: 0.173360 Aug 31 05:42:28.309604 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 640/1277] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:28 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:28.331047 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:42:28.331640 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:42:28.338396 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:28.338856 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:28.339288 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:28.339949 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:28.340508 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:28.340958 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:28.474432 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:42:28.484406 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-b542fdf5-e9b6-48ed-83c1-b20eebd42adc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1454 microversion: 2.1 time: 0.157276 Aug 31 05:42:28.484992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 638/1278] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:42:28 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:42:30.423460 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-adaa9c00-61e8-4f72-9340-e7cb4b4a5781 req-da863688-553b-4204-85d8-725bb056a881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ee8173-a9aa-4d78-9181-d0156a3bbad4", "tag": "f8da5ab4-3d91-4b9b-b05c-5b2291e81d28"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:42:30.432949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-adaa9c00-61e8-4f72-9340-e7cb4b4a5781 req-da863688-553b-4204-85d8-725bb056a881 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:42:30.433410 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-adaa9c00-61e8-4f72-9340-e7cb4b4a5781 req-da863688-553b-4204-85d8-725bb056a881 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:42:30.433820 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-adaa9c00-61e8-4f72-9340-e7cb4b4a5781 req-da863688-553b-4204-85d8-725bb056a881 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:42:30.445007 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-adaa9c00-61e8-4f72-9340-e7cb4b4a5781 req-da863688-553b-4204-85d8-725bb056a881 service nova] Creating event network-changed:f8da5ab4-3d91-4b9b-b05c-5b2291e81d28 for instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 on hv-cinder-85220 Aug 31 05:42:30.450153 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-adaa9c00-61e8-4f72-9340-e7cb4b4a5781 req-da863688-553b-4204-85d8-725bb056a881 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030235 Aug 31 05:42:30.450748 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 641/1279] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:44:20.511743 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_api:SELECT=20 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:44:20.513152 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG dbcounter [-] [120607] Writing DB stats nova_cell1:SELECT=48 {{(pid=120607) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:44:20.514255 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:44:20.514497 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Wed Aug 31 05:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 (ip 10.222.0.36) !!! Aug 31 05:44:20.515800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2312fd2a-b124-4b05-a47e-cf828e551399] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 05:44:20.516884 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:44:20.517971 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG dbcounter [-] [120608] Writing DB stats nova_cell1:SELECT=44 {{(pid=120608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:44:20.518936 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:44:20.519097 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Wed Aug 31 05:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 (ip 10.222.0.36) !!! Aug 31 05:44:20.519187 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 05:44:20.519272 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Wed Aug 31 05:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Aug 31 05:44:20.526458 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-a058f22a-ecd9-409f-8134-fe95b421fd33 req-acd89f0c-edc9-452f-a898-9d70a8a03ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ee8173-a9aa-4d78-9181-d0156a3bbad4", "tag": "f8da5ab4-3d91-4b9b-b05c-5b2291e81d28"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:44:20.531091 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:20.531577 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:20.545837 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a058f22a-ecd9-409f-8134-fe95b421fd33 req-acd89f0c-edc9-452f-a898-9d70a8a03ea7 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:20.546257 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:20.546378 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a058f22a-ecd9-409f-8134-fe95b421fd33 req-acd89f0c-edc9-452f-a898-9d70a8a03ea7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:20.546711 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:20.546827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-a058f22a-ecd9-409f-8134-fe95b421fd33 req-acd89f0c-edc9-452f-a898-9d70a8a03ea7 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:20.547133 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:20.547813 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:20.548258 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:20.548657 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:20.559878 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-a058f22a-ecd9-409f-8134-fe95b421fd33 req-acd89f0c-edc9-452f-a898-9d70a8a03ea7 service nova] Creating event network-changed:f8da5ab4-3d91-4b9b-b05c-5b2291e81d28 for instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 on hv-cinder-85220 Aug 31 05:44:20.565702 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-a058f22a-ecd9-409f-8134-fe95b421fd33 req-acd89f0c-edc9-452f-a898-9d70a8a03ea7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052479 Aug 31 05:44:20.566676 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 642/1280] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:44:20.579758 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Going to try to terminate instance {{(pid=120607) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:44:20.675115 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ec11ff3c-e86b-4439-968d-c779edc0e951 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "DELETE /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 204 len: 0 microversion: 2.1 time: 0.165017 Aug 31 05:44:20.678986 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 639/1281] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:44:20 2022] DELETE /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:44:20.685608 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:20.686508 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:20.693425 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:20.693627 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:20.693941 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:20.694659 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:20.695090 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:20.695543 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:20.859193 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:44:20.867158 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-14b7e7a3-261d-4ed8-84e5-5bca369e43bc tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1579 microversion: 2.1 time: 0.186378 Aug 31 05:44:20.867662 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 643/1282] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:20 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1579 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:44:21.889444 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:21.890201 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:21.896809 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:21.897284 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:21.897708 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:21.898418 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:21.898856 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:21.899266 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:22.052989 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:44:22.061625 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-650ca434-1594-49ef-811e-2c1801f151a7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1579 microversion: 2.1 time: 0.176452 Aug 31 05:44:22.062233 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 640/1283] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:21 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1579 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:44:23.036818 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-2ab1b7a4-237e-4a15-85dc-4bf9ea8a399a req-30d6e69e-c6fe-4a4b-ae10-b229ba22ace3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ee8173-a9aa-4d78-9181-d0156a3bbad4", "name": "network-vif-deleted", "tag": "f8da5ab4-3d91-4b9b-b05c-5b2291e81d28"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:44:23.046977 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2ab1b7a4-237e-4a15-85dc-4bf9ea8a399a req-30d6e69e-c6fe-4a4b-ae10-b229ba22ace3 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:23.047481 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2ab1b7a4-237e-4a15-85dc-4bf9ea8a399a req-30d6e69e-c6fe-4a4b-ae10-b229ba22ace3 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:23.047949 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-2ab1b7a4-237e-4a15-85dc-4bf9ea8a399a req-30d6e69e-c6fe-4a4b-ae10-b229ba22ace3 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:23.062596 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-2ab1b7a4-237e-4a15-85dc-4bf9ea8a399a req-30d6e69e-c6fe-4a4b-ae10-b229ba22ace3 service nova] Creating event network-vif-deleted:f8da5ab4-3d91-4b9b-b05c-5b2291e81d28 for instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 on hv-cinder-85220 Aug 31 05:44:23.066023 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO oslo.messaging._drivers.impl_rabbit [-] [2312fd2a-b124-4b05-a47e-cf828e551399] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48484. Aug 31 05:44:23.067673 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-2ab1b7a4-237e-4a15-85dc-4bf9ea8a399a req-30d6e69e-c6fe-4a4b-ae10-b229ba22ace3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035082 Aug 31 05:44:23.068504 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 644/1284] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:44:23.082870 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:23.083479 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:23.090513 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:23.090992 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:23.091423 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:23.092098 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:23.092543 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:23.092959 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:23.162942 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:44:23.171296 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-e1b0b690-b8a8-405d-abe8-7720c76ccf2d tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 200 len: 1225 microversion: 2.1 time: 0.092442 Aug 31 05:44:23.171840 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 641/1285] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:23 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:44:24.197160 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:24.197826 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 78ee8173-a9aa-4d78-9181-d0156a3bbad4] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:24.205442 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:24.206034 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:24.206551 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:24.207348 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:24.207875 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:24.208364 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:24.223859 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] HTTP exception thrown: Instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 could not be found. Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Request method failure captured: Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 HTTP/1.1 Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvNkt80UL5OnqqG_bN196PHffypnbP55ZvoGoTjkamsLE_cIhK7MuezodAGJyTTn-MTWvhWUaxTMEAawuJR15k7pEdZuaS_ZYiywk___iuxFFYKLnaYdPis4u9Z_6IEzjDPsyQB8X0P5Z4sk1X7qbUOtdi8d_ty9ysgfbahMiwupqPA Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:44:24.225785 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c2ff14d7aca45419054434365802dbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 8ae25b465a47404a80b7f40580e70884 Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 could not be found. Aug 31 05:44:24.228256 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '78ee8173-a9aa-4d78-9181-d0156a3bbad4'} Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 could not be found. Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:44:24.229233 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 could not be found. Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 could not be found. Aug 31 05:44:24.230992 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:24.232516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Returning 404 to user: Instance 78ee8173-a9aa-4d78-9181-d0156a3bbad4 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:44:24.232516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-b8c08d3c-f84d-409a-b2b9-d192ab4f3761 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4" status: 404 len: 111 microversion: 2.1 time: 0.037592 Aug 31 05:44:24.232516 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 645/1286] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:24 2022] GET /compute/v2.1/servers/78ee8173-a9aa-4d78-9181-d0156a3bbad4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:44:27.335487 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:27.336011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:27.343236 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:27.343711 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:27.344146 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:27.344833 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:27.345269 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:27.345675 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:27.371968 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Going to try to terminate instance {{(pid=120607) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 05:44:27.400963 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-f9267d72-dc4f-4cf2-8e24-4293075b9e71 req-4e9dd0f7-5f15-4314-8b5d-e88287821a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5f6015-2e91-4eab-bbcd-6925749d4b71", "tag": "46732fec-2f32-4067-933b-e6d48b32064f"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:44:27.410503 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f9267d72-dc4f-4cf2-8e24-4293075b9e71 req-4e9dd0f7-5f15-4314-8b5d-e88287821a47 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:27.411292 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f9267d72-dc4f-4cf2-8e24-4293075b9e71 req-4e9dd0f7-5f15-4314-8b5d-e88287821a47 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:27.411801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-f9267d72-dc4f-4cf2-8e24-4293075b9e71 req-4e9dd0f7-5f15-4314-8b5d-e88287821a47 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:27.424822 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-f9267d72-dc4f-4cf2-8e24-4293075b9e71 req-4e9dd0f7-5f15-4314-8b5d-e88287821a47 service nova] Creating event network-changed:46732fec-2f32-4067-933b-e6d48b32064f for instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 on hv-cinder-85220 Aug 31 05:44:27.430829 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-f9267d72-dc4f-4cf2-8e24-4293075b9e71 req-4e9dd0f7-5f15-4314-8b5d-e88287821a47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096561 Aug 31 05:44:27.432086 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 646/1287] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 05:44:27.456417 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-682f677c-5bad-468c-b17d-992c31f995d7 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 204 len: 0 microversion: 2.1 time: 0.124685 Aug 31 05:44:27.457011 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 642/1288] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:44:27 2022] DELETE /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 05:44:27.466076 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:27.466855 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:27.473078 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:27.473800 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:27.474416 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:27.475289 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:27.475890 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:27.476465 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:27.612827 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.policy [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120608) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:44:27.620852 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-24fdaff2-440c-4cba-bc3f-4b25e75fc4dd tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1576 microversion: 2.1 time: 0.159372 Aug 31 05:44:27.621429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 647/1289] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:27 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:44:28.643162 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:28.643859 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:28.650468 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:28.650956 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:28.651400 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:28.652090 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:28.652534 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:28.653157 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:28.823967 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:44:28.834040 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-74b7148c-193d-4f5e-a734-6f0ed167bf89 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1576 microversion: 2.1 time: 0.195524 Aug 31 05:44:28.834613 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 643/1290] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:28 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:44:29.786919 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [req-1ce56edd-473a-4497-86f6-41b2e8922c4b req-a4ec3c4a-f34f-459d-a351-78453e6d5951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5f6015-2e91-4eab-bbcd-6925749d4b71", "name": "network-vif-deleted", "tag": "46732fec-2f32-4067-933b-e6d48b32064f"}]} {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 05:44:29.797178 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1ce56edd-473a-4497-86f6-41b2e8922c4b req-a4ec3c4a-f34f-459d-a351-78453e6d5951 service nova] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:29.797638 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1ce56edd-473a-4497-86f6-41b2e8922c4b req-a4ec3c4a-f34f-459d-a351-78453e6d5951 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:29.798069 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [req-1ce56edd-473a-4497-86f6-41b2e8922c4b req-a4ec3c4a-f34f-459d-a351-78453e6d5951 service nova] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:29.809647 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.compute.server_external_events [req-1ce56edd-473a-4497-86f6-41b2e8922c4b req-a4ec3c4a-f34f-459d-a351-78453e6d5951 service nova] Creating event network-vif-deleted:46732fec-2f32-4067-933b-e6d48b32064f for instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 on hv-cinder-85220 Aug 31 05:44:29.814429 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [req-1ce56edd-473a-4497-86f6-41b2e8922c4b req-a4ec3c4a-f34f-459d-a351-78453e6d5951 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031316 Aug 31 05:44:29.815348 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 648/1291] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 05:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 05:44:29.857081 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:29.857791 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:29.865388 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:29.865950 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:29.866470 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:29.867225 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:29.867741 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:29.868245 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:29.935068 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.policy [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ae25b465a47404a80b7f40580e70884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c2ff14d7aca45419054434365802dbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120607) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 05:44:29.943615 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-42dd9f31-c3f2-41e0-aa43-041853628f77 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 200 len: 1224 microversion: 2.1 time: 0.092274 Aug 31 05:44:29.944195 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 644/1292] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:29 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 05:44:30.966080 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:30.966676 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: dd5f6015-2e91-4eab-bbcd-6925749d4b71] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:30.973394 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:30.973860 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:30.974624 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:30.975034 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:30.975574 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:30.975989 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:30.990426 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] HTTP exception thrown: Instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 could not be found. Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Request method failure captured: Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 HTTP/1.1 Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvNkt80UL5OnqqG_bN196PHffypnbP55ZvoGoTjkamsLE_cIhK7MuezodAGJyTTn-MTWvhWUaxTMEAawuJR15k7pEdZuaS_ZYiywk___iuxFFYKLnaYdPis4u9Z_6IEzjDPsyQB8X0P5Z4sk1X7qbUOtdi8d_ty9ysgfbahMiwupqPA Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:44:30.992101 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c2ff14d7aca45419054434365802dbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 8ae25b465a47404a80b7f40580e70884 Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 could not be found. Aug 31 05:44:30.993801 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': 'dd5f6015-2e91-4eab-bbcd-6925749d4b71'} Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 could not be found. Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:44:30.994719 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 could not be found. Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 could not be found. Aug 31 05:44:30.996215 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:30.998466 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Returning 404 to user: Instance dd5f6015-2e91-4eab-bbcd-6925749d4b71 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:44:30.998466 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-6b6c87c3-2d8b-4861-9f2b-2b8e45479304 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71" status: 404 len: 111 microversion: 2.1 time: 0.032350 Aug 31 05:44:30.998466 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 649/1293] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:30 2022] GET /compute/v2.1/servers/dd5f6015-2e91-4eab-bbcd-6925749d4b71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:44:31.472179 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:31.472721 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.compute.api [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120607) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:31.480065 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:31.480476 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:31.480930 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:31.481597 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:31.482039 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:31.482478 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG oslo_concurrency.lockutils [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120607) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:31.495662 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.wsgi [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] HTTP exception thrown: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Request method failure captured: Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: request: DELETE /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 HTTP/1.1 Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept: application/json Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Accept-Encoding: identity Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Connection: close Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Length: 0 Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Content-Type: application/json Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Host: 10.222.0.36 Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: Openstack-System-Scope: None Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: User-Agent: python-urllib3/1.26.12 Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Auth-Token: gAAAAABjDvNkt80UL5OnqqG_bN196PHffypnbP55ZvoGoTjkamsLE_cIhK7MuezodAGJyTTn-MTWvhWUaxTMEAawuJR15k7pEdZuaS_ZYiywk___iuxFFYKLnaYdPis4u9Z_6IEzjDPsyQB8X0P5Z4sk1X7qbUOtdi8d_ty9ysgfbahMiwupqPA Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Id: None Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Domain-Name: None Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Identity-Status: Confirmed Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Is-Admin-Project: True Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Id: default Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Domain-Name: Default Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Project-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Role: reader,member Aug 31 05:44:31.497295 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Roles: reader,member Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c2ff14d7aca45419054434365802dbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-Tenant-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Id: default Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Domain-Name: Default Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Id: 8ae25b465a47404a80b7f40580e70884 Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: X-User-Name: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: method: > Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: exception: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.499045 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: action_args: {'id': '800cf21c-8f74-445b-952b-ec8cca4a4858'} Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:44:31.500217 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.501834 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.503573 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Returning 404 to user: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. {{(pid=120607) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:44:31.503573 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-392e39d6-a654-4b68-9dd4-f7f117b90b63 tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "DELETE /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 404 len: 111 microversion: 2.1 time: 0.030796 Aug 31 05:44:31.503573 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 645/1294] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 05:44:31 2022] DELETE /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:44:31.507349 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '>' {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:31.507951 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.compute.api [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] [instance: 800cf21c-8f74-445b-952b-ec8cca4a4858] Fetching instance by UUID {{(pid=120608) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 05:44:31.513968 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:31.514473 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:31.514904 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:31.515578 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Acquiring lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 05:44:31.516024 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 05:44:31.516435 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG oslo_concurrency.lockutils [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Lock "6c5b09df-1bba-4015-8eaa-e92ec93ae071" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 05:44:31.529727 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.wsgi [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] HTTP exception thrown: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Request method failure captured: Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: request: GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 HTTP/1.1 Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept: application/json Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Accept-Encoding: identity Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Connection: close Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Length: 0 Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Content-Type: application/json Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Host: 10.222.0.36 Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: Openstack-System-Scope: None Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: User-Agent: python-urllib3/1.26.12 Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Auth-Token: gAAAAABjDvNkt80UL5OnqqG_bN196PHffypnbP55ZvoGoTjkamsLE_cIhK7MuezodAGJyTTn-MTWvhWUaxTMEAawuJR15k7pEdZuaS_ZYiywk___iuxFFYKLnaYdPis4u9Z_6IEzjDPsyQB8X0P5Z4sk1X7qbUOtdi8d_ty9ysgfbahMiwupqPA Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Id: None Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Domain-Name: None Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Identity-Status: Confirmed Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Is-Admin-Project: True Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Id: default Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Domain-Name: Default Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Project-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Role: reader,member Aug 31 05:44:31.531260 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Roles: reader,member Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8c2ff14d7aca45419054434365802dbf", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8c2ff14d7aca45419054434365802dbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}] Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Id: 8c2ff14d7aca45419054434365802dbf Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-Tenant-Name: tempest-TestVolumeBootPattern-411905407 Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Id: default Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Domain-Name: Default Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Id: 8ae25b465a47404a80b7f40580e70884 Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: X-User-Name: tempest-TestVolumeBootPattern-411905407-project Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: method: > Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: exception: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.532973 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: action_args: {'id': '800cf21c-8f74-445b-952b-ec8cca4a4858'} Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: {{(pid=120608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 05:44:31.534244 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. Aug 31 05:44:31.536053 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: ERROR nova.api.openstack.wsgi Aug 31 05:44:31.537563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: DEBUG nova.api.openstack.wsgi [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Returning 404 to user: Instance 800cf21c-8f74-445b-952b-ec8cca4a4858 could not be found. {{(pid=120608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 05:44:31.537563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: INFO nova.api.openstack.requestlog [None req-95dfdbd6-902f-401d-934f-bb412b17ad0b tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858" status: 404 len: 111 microversion: 2.1 time: 0.029178 Aug 31 05:44:31.537563 dv-cinder-852208-14-iscsi devstack@n-api.service[120608]: [pid: 120608|app: 0|req: 650/1295] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 05:44:31 2022] GET /compute/v2.1/servers/800cf21c-8f74-445b-952b-ec8cca4a4858 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 05:44:32.852305 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: DEBUG nova.api.openstack.wsgi [None req-ead9afb8-cf3b-4613-bdf4-810b510e990f tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] Calling method '.version_select at 0x7fbd0e992670>' {{(pid=120607) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 05:44:32.878052 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: INFO nova.api.openstack.requestlog [None req-ead9afb8-cf3b-4613-bdf4-810b510e990f tempest-TestVolumeBootPattern-411905407 tempest-TestVolumeBootPattern-411905407-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-741954775" status: 202 len: 0 microversion: 2.1 time: 0.029904 Aug 31 05:44:32.878727 dv-cinder-852208-14-iscsi devstack@n-api.service[120607]: [pid: 120607|app: 0|req: 646/1296] 10.222.0.36 () {58 vars in 1260 bytes} [Wed Aug 31 05:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-741954775 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)